-- Logs begin at Tue 2022-09-06 11:07:25 UTC, end at Tue 2022-09-06 12:12:21 UTC. -- Sep 06 11:33:40.385843 dv-cinder-856041-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 11:33:40 2022] *** Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: nodename: dv-cinder-856041-1-smb Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: machine: x86_64 Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: clock source: unix Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: pcre jit disabled Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: detected number of CPU cores: 4 Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: current working directory: / Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: detected binary path: /usr/bin/uwsgi-core Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: your processes number limit is 47680 Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: your memory page size is 4096 bytes Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: detected max file descriptor number: 2048 Sep 06 11:33:40.396819 dv-cinder-856041-1-smb devstack@keystone.service[88020]: lock engine: pthread robust mutexes Sep 06 11:33:40.398051 dv-cinder-856041-1-smb devstack@keystone.service[88020]: thunder lock: enabled Sep 06 11:33:40.398051 dv-cinder-856041-1-smb devstack@keystone.service[88020]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 11:33:40.398051 dv-cinder-856041-1-smb devstack@keystone.service[88020]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 11:33:40.436471 dv-cinder-856041-1-smb devstack@keystone.service[88020]: Python main interpreter initialized at 0x564ffd1799c0 Sep 06 11:33:40.436471 dv-cinder-856041-1-smb devstack@keystone.service[88020]: python threads support enabled Sep 06 11:33:40.436471 dv-cinder-856041-1-smb devstack@keystone.service[88020]: your server socket listen backlog is limited to 100 connections Sep 06 11:33:40.436471 dv-cinder-856041-1-smb devstack@keystone.service[88020]: your mercy for graceful operations on workers is 90 seconds Sep 06 11:33:40.436888 dv-cinder-856041-1-smb devstack@keystone.service[88020]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 11:33:40.436888 dv-cinder-856041-1-smb devstack@keystone.service[88020]: *** Operational MODE: preforking *** Sep 06 11:33:40.437187 dv-cinder-856041-1-smb devstack@keystone.service[88020]: *** uWSGI is running in multiple interpreter mode *** Sep 06 11:33:40.437187 dv-cinder-856041-1-smb devstack@keystone.service[88020]: spawned uWSGI master process (pid: 88020) Sep 06 11:33:40.437421 dv-cinder-856041-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 06 11:33:40.442713 dv-cinder-856041-1-smb devstack@keystone.service[88020]: spawned uWSGI worker 1 (pid: 88032, cores: 1) Sep 06 11:33:40.442713 dv-cinder-856041-1-smb devstack@keystone.service[88020]: spawned uWSGI worker 2 (pid: 88033, cores: 1) Sep 06 11:33:40.442713 dv-cinder-856041-1-smb devstack@keystone.service[88020]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 11:33:44.699364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:33:44.699364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: from cryptography.utils import int_from_bytes Sep 06 11:33:44.700243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:33:44.700243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: from cryptography.utils import int_from_bytes Sep 06 11:33:44.700683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:33:44.700683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: from cryptography.utils import int_from_bytes Sep 06 11:33:44.700793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:33:44.700793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: from cryptography.utils import int_from_bytes Sep 06 11:33:44.750008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 11:33:44.750237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 11:33:44.750321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 11:33:44.750399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] command line args: [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 11:33:44.750460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 11:33:44.750593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 11:33:44.750704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] command line args: [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 11:33:44.750782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ================================================================================ {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 11:33:44.750933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 11:33:44.751023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] admin_token = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ================================================================================ {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 11:33:44.751296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] config_dir = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] admin_token = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] config_source = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] config_dir = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] debug = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.751994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] config_source = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] debug = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.752999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_config_append = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_config_append = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_dir = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_file = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.753927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_dir = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_file = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.754935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.755945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.756951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.757994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] publish_errors = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] publish_errors = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.758973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] standard_threads = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] standard_threads = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.759985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] use_journal = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] use_json = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] use_journal = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] use_stderr = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] use_json = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] use_syslog = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] use_stderr = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.760946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] use_syslog = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.761090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:33:44.761177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.761338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.761427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.761574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.761662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.761825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.761912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.762905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.763841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.764969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.765934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.766956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.767962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.768906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.769862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.770959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.771942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.772984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773094 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.773874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.774924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.775966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776816 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.776895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.777921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778094 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.778958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.779916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.780944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.781893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.782964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.783959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.784949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.785895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.external = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.786876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.external = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.password = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] auth.token = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.787893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.password = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] auth.token = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.788978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.789926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.790928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.791959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.792995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.793959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.794932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.795893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.796924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.797946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.798921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.799948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.800931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.801882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.802909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.803891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.804988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.805939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.806906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.807983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.808927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.809968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.810952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.811887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.812866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.813969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.814943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.815976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.816918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817399 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.817869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.818888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.819991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] role.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] role.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] role.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] role.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.820925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.821915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.822966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.823963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.824139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.824297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.824537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.824616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.824773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.824852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.825988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.826970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.827940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.828956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.829902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.830897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.831851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.832991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.connection = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.connection = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.833919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.834904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.835991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.836938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.837797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 11:33:44.837870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:33:44.838023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 11:33:44.867508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.867737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.868013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.868148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.868336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.876326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.876754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.904171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.904436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.904654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.904839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.957189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:44.957434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.005298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.005551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.006286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.006490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.164635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.164944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.165773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.166011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.188651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.188898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.188997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.189997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.190125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.190265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.190397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.190397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.201143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.201607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.213960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.214964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.215116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.215221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.215304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88033) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.215368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.215368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.215616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 11:33:45.232264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.232486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 11:33:45.232757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.232886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.233034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 11:33:45.233227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 11:33:45.233227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.233434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.233434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 11:33:45.233623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.233719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.233845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.233977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.234141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.234279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.234484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.243683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.243961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.244232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.244359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.244514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.244705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.244797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.245046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.251521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.252087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.254422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.254675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.255290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255699 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.255962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.256931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.257063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.257192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.257322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.257463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.257715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.279797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.280426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.281261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.281546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.281900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.282185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.286220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.286505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.286840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.287076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.287187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.287474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.293173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.293456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.293838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.294131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.299154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.299452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.299732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.299931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.300093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.300249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.300387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.300544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.300768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.301054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.301336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.301636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.301763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.301886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.302056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.302320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.317496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.317784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.318135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.318427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.321742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.322313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.325026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.325323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.325575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.325875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.329556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.330097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.332736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.333280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.336143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.336441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.336663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.336766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.336993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.337131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.337227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.337296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.337657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.337782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.337862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.338122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.353736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.354027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.354195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.354291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.354517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.354663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.354776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.355067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.361448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.361921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.363025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.363485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.364572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.364849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.365067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.365380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.367623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.367901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.368021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.368164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.368292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.368504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.368632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.368895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.369036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.369289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.380074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.380360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.380486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.380652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.380743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.380961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.381138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.381224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.381406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.381677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.381864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.381960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.382089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.382216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.397394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.397818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.400338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.400616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.403258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.403504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.404704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.404962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.406277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.406403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.406717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.406839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.407071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.407167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.413471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.413666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.414971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.415118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.417832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.417958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.418208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.418304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.418552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.418649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.418838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.418964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.426580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.426784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.426974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.427066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.427196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.427340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.434123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.434325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88033) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 11:33:45.434465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.434598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.434771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.434903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.435977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.436917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.437705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.437851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.437987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.437987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.438234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.438365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88033) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.438506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 11:33:45.471817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ffd1799c0 pid: 88033 (default app) Sep 06 11:33:45.471952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ffd1799c0 pid: 88032 (default app) Sep 06 11:33:45.475577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d2f3f-3f9f-4545-8ece-97ee9d93ee0a None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:45.475865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d2f3f-3f9f-4545-8ece-97ee9d93ee0a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:45.476136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d2f3f-3f9f-4545-8ece-97ee9d93ee0a None None] PATH_INFO: `/v3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:45.480391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue Sep 6 11:33:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:33:52.114466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:52.115043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:52.115043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:52.119346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:33:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:33:52.124956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:52.125437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:52.125580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:52.202030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: INFO dbcounter [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] Registered counter for database keystone Sep 06 11:33:52.223793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG oslo_db.sqlalchemy.engines [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:33:52.235437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writer thread running {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:33:52.432282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG passlib.handlers.bcrypt [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88032) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 11:33:52.432855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG passlib.handlers.bcrypt [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88032) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 11:33:52.501387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:52.503982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:52.642719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:33:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 06 11:33:53.159053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:53.229406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: INFO dbcounter [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] Registered counter for database keystone Sep 06 11:33:53.254312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG oslo_db.sqlalchemy.engines [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:33:53.265534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writer thread running {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:33:53.394964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae92ea-e8d0-4dc7-8b5c-ec3451446c49 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:53.400617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:53.401267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:53.401543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:53.401814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:53.411803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:53.463050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 11:33:53.463391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaddb7-de2f-4b8c-99bc-1cb9987ae7e4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:53.475273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Sep 6 11:33:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:33:53.482110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:53.498316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22448-d943-4665-b405-726781ef0f61 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:53.504199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:53.505371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:53.505655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:53.505936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] PATH_INFO: `/v3/projects/b38d4dcd6a0e45e880f97fafaba71561` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:53.507715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] RBAC: Authorizing `identity:get_project(project_id=b38d4dcd6a0e45e880f97fafaba71561)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:53.560991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING keystone.common.rbac_enforcer.enforcer [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 11:33:53.561333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87671a26-2408-454f-8cc7-0df620f4ea0b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:53.566113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue Sep 6 11:33:53 2022] GET /identity/v3/projects/b38d4dcd6a0e45e880f97fafaba71561 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:33:55.432246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7e9e-b592-4ee9-b766-bc4dbacc929d None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:55.432817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7e9e-b592-4ee9-b766-bc4dbacc929d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:55.432817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7e9e-b592-4ee9-b766-bc4dbacc929d None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:55.436989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:33:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:33:55.444093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:55.444717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:55.444839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:55.477265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:55.478864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:55.489208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:33:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 11:33:55.759822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df7e9e-b592-4ee9-b766-bc4dbacc929d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:55.773126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df7e9e-b592-4ee9-b766-bc4dbacc929d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:55.781806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56a13b-4870-480f-81ff-7285ec93c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:55.781806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56a13b-4870-480f-81ff-7285ec93c66c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:55.781806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56a13b-4870-480f-81ff-7285ec93c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:55.781806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56a13b-4870-480f-81ff-7285ec93c66c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:55.789833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56a13b-4870-480f-81ff-7285ec93c66c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:55.792004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56a13b-4870-480f-81ff-7285ec93c66c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:55.802375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Sep 6 11:33:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:33:55.809142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:55.822108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98087f-7686-4437-8bdf-8279fa466353 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:55.829346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0979f8-7772-4d9d-8f14-18d7b298eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:55.829989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0979f8-7772-4d9d-8f14-18d7b298eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:55.830266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0979f8-7772-4d9d-8f14-18d7b298eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:55.830568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0979f8-7772-4d9d-8f14-18d7b298eb5c admin admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:55.832124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0979f8-7772-4d9d-8f14-18d7b298eb5c admin admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:55.834096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0979f8-7772-4d9d-8f14-18d7b298eb5c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:55.835721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue Sep 6 11:33:55 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:33:57.810761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6902-2cbe-436b-8929-d383a70d5f14 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:57.811400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6902-2cbe-436b-8929-d383a70d5f14 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:57.811400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6902-2cbe-436b-8929-d383a70d5f14 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:57.812680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:33:57.818052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:57.818540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:57.818643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:57.837891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:57.839136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:57.905030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fb9c0-6d1c-4465-b283-1becde4fe4c4 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:57.905298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fb9c0-6d1c-4465-b283-1becde4fe4c4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:57.905563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fb9c0-6d1c-4465-b283-1becde4fe4c4 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:57.907104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:33:57.912652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:57.912938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:57.913325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:57.926504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:33:57.956864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG passlib.handlers.bcrypt [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88033) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 11:33:57.957260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG passlib.handlers.bcrypt [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88033) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 11:33:58.006034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:58.007660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:58.110708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:33:58.189860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.218876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.303922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5913a-fbe0-425a-bc63-da0c06d73d49 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.337023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.337566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.337841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.338108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.349959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:33:58.358712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:33:58.359667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:33:58.360510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:33:58.365864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.377924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.466981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.471655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b142d-b5fd-48ba-8423-6d8fba1cecf9 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.474466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.487286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4127d-453c-4378-906f-175ccd2efd0b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.509724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.510615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.510926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.511200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.512049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:33:58.512384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.513839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.521916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.522525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.522843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.523111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.526201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:33:58.532112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.592419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.593930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.631984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b0c1-2eff-45b8-9f8d-4820e17ef9d0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.665174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.666065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.666342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.666609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.668158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.669626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.671241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 9/16] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:33:58.675346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.676948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.694481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 11:33:58.700250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.712736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.782242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046663-d56a-4d93-9e56-88d045b67337 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.801588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4586d-a2b1-4d6a-88bc-20c686dd63f5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.814724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.815359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.815633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.815888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.817047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.818551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.820231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:33:58.826133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.838363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.839058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.839336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.839608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.850525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.851989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:33:58.866963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:33:58.867919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:33:58.868735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:33:58.868735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:33:58.868735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:33:58.868735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:33:58.874212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.909778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.928458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc4f6d-a474-42dc-9a35-478203eed9e2 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.929974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:58.965770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.966392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.966676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.966978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.967710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.domain.id=default, user.id=998dc91652fe4a80ad7901f3f3010bad) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:33:58.968019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.969490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cfcdd-c36e-4cb7-8a2b-4c031e036053 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.978615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/role_assignments?user.id=998dc91652fe4a80ad7901f3f3010bad&scope.domain.id=default&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:33:58.978777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942541-34db-4822-abd6-10921c2f3cda None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:59.017741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:59.018383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:59.018648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:59.018956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:59.019611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:33:59.019912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:59.021414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5e4b-6e3d-4539-b46d-4be65f3661cd None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:59.040955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:01.260162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4977739-9f4f-4932-a7bd-7b5370ee9ef6 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.261161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4977739-9f4f-4932-a7bd-7b5370ee9ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.261662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4977739-9f4f-4932-a7bd-7b5370ee9ef6 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.263308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:01.269481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0d60f-6894-4f41-8e95-7a5bbb7a9db8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.269987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0d60f-6894-4f41-8e95-7a5bbb7a9db8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.270285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0d60f-6894-4f41-8e95-7a5bbb7a9db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.299323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8bc0d60f-6894-4f41-8e95-7a5bbb7a9db8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:01.300053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a252-e106-4991-8ba6-a336bfbdeb26 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.300341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a252-e106-4991-8ba6-a336bfbdeb26 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.300507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8bc0d60f-6894-4f41-8e95-7a5bbb7a9db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:01.300691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a252-e106-4991-8ba6-a336bfbdeb26 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.302194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:01.307452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.307726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.308004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.330773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:01.332707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:01.384784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:01.386076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5c09-ea47-49d0-83d6-0c494b0f533a None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.386482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5c09-ea47-49d0-83d6-0c494b0f533a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.386785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5c09-ea47-49d0-83d6-0c494b0f533a None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.388456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 12/25] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:01.402957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.403347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.403628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.432381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:01.433049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:01.439451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:01.468204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:01.529621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:01.760733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.815911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.941776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:01.955960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eac7e-756d-4621-92e7-2608afa6ab0e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.010933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ff15a-cf5f-48a7-a92d-ca452897e157 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.021649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.022307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.022672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.022964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.044488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:02.055492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a0ae8-9172-469d-9206-5e954ea1a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.056084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a0ae8-9172-469d-9206-5e954ea1a69b None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.056362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a0ae8-9172-469d-9206-5e954ea1a69b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.056665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a0ae8-9172-469d-9206-5e954ea1a69b None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.057339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a0ae8-9172-469d-9206-5e954ea1a69b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:02.058140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:02.058997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:02.059810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 15/28] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:02.061286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a0ae8-9172-469d-9206-5e954ea1a69b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.071867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.244861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1acf-fab5-4bc3-9cad-e471444b703f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.246630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 14/29] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/roles => generated 219 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:02.247921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219115-bb28-4334-b19d-8530b9c70498 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.248205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219115-bb28-4334-b19d-8530b9c70498 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.248477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219115-bb28-4334-b19d-8530b9c70498 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.249902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:02.250400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219115-bb28-4334-b19d-8530b9c70498 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.290057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.291514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.292035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.292504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.293387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:02.293900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.295589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fccfa9-a53b-4b3d-a64f-61d57c10675a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.297604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:02.306806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:02.311503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.312011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.312506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.334408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:02.336018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:02.354271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:02.417406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 17/32] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:02.418895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.512232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219115-bb28-4334-b19d-8530b9c70498 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.528644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9a3e8-3eee-4f68-bf90-c50bc5367af7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.564996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.566050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.566576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.567099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.568715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.570461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.576955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 18/33] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:02.578470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.583316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.583683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.584004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.584276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.599880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:02.604811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.607386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-1c797c9b-5405-4ce7-8396-e095309ef9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:34:02.629505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:02.630483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:34:02.631783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:34:02.631783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:34:02.631783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:02.631783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 16/34] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:02.632217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0550e4-75d4-49c4-b8fc-42d0e9f1fba5 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.632420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0550e4-75d4-49c4-b8fc-42d0e9f1fba5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.632916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0550e4-75d4-49c4-b8fc-42d0e9f1fba5 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.634556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 17/35] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:02.639862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0550e4-75d4-49c4-b8fc-42d0e9f1fba5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.736094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9f95b-a538-4ed3-bb9d-3d0e255a94be None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.747039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:02.781945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79b8ea-4d21-4214-a2b4-be1cef92bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.782595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79b8ea-4d21-4214-a2b4-be1cef92bac3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.783109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79b8ea-4d21-4214-a2b4-be1cef92bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.783385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79b8ea-4d21-4214-a2b4-be1cef92bac3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.784808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79b8ea-4d21-4214-a2b4-be1cef92bac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.786529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79b8ea-4d21-4214-a2b4-be1cef92bac3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.788183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 19/36] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:02.788317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0550e4-75d4-49c4-b8fc-42d0e9f1fba5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.795775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.795775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.795775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.817208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:02.818749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:02.832062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.832696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.833052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.833394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.834061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:02.834376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.835847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.848108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 18/37] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:02.849036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.903505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 20/38] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:02.904863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.928526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:03.040580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67e50f-33ca-45f9-b95c-2572b956f636 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.075299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2140bc-008a-4a24-8b84-f5abf08fba7b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.077610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98cf0f-36b4-4c24-ac47-99d3a03e656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.078355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf0f-36b4-4c24-ac47-99d3a03e656d None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.078517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf0f-36b4-4c24-ac47-99d3a03e656d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.078820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf0f-36b4-4c24-ac47-99d3a03e656d None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.079508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98cf0f-36b4-4c24-ac47-99d3a03e656d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.080910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98cf0f-36b4-4c24-ac47-99d3a03e656d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.106396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:03.116578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.117267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.117545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.117817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] PATH_INFO: `/v3/domains/default/users/998dc91652fe4a80ad7901f3f3010bad/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.119901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=998dc91652fe4a80ad7901f3f3010bad, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.121347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.137055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 19/39] 10.222.0.49 () {58 vars in 1361 bytes} [Tue Sep 6 11:34:02 2022] PUT /identity/v3/domains/default/users/998dc91652fe4a80ad7901f3f3010bad/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:03.137626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.217223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 6 11:34:02 2022] POST /identity/v3/roles => generated 225 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:03.218842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffacd9a-90a3-4721-b898-6ca69d919da9 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.219193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffacd9a-90a3-4721-b898-6ca69d919da9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.219475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffacd9a-90a3-4721-b898-6ca69d919da9 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.220847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 22/41] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:03.221646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffacd9a-90a3-4721-b898-6ca69d919da9 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.270804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52753a13-0b05-4b51-907c-186bf81507a6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.326262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:03.334777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fa086-2022-454d-aec1-568d62333219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.335388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fa086-2022-454d-aec1-568d62333219 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.335637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fa086-2022-454d-aec1-568d62333219 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.335826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fa086-2022-454d-aec1-568d62333219 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.337822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fa086-2022-454d-aec1-568d62333219 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.339119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fa086-2022-454d-aec1-568d62333219 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.365054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffacd9a-90a3-4721-b898-6ca69d919da9 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.389069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 20/42] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/projects => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:03.390649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.391154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.391440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.412837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:03.414450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:03.416264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.417644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.418177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.419401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.419838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.421454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.444617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 23/43] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:03.471428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:03.523914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:03.811696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.918577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5209-4aae-44b3-950a-dfeab6dc34ff None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.952329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b2c7-6858-4d98-b25e-ff9a185c2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.952974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b2c7-6858-4d98-b25e-ff9a185c2c9a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.953229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b2c7-6858-4d98-b25e-ff9a185c2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.953533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b2c7-6858-4d98-b25e-ff9a185c2c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.954792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b2c7-6858-4d98-b25e-ff9a185c2c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.956266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b2c7-6858-4d98-b25e-ff9a185c2c9a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.958095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:03.963720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:04.071716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f80853-98ed-417b-8804-4be97842b17a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:04.108889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb40bca-fd41-4999-af41-4471dee864be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:04.109508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb40bca-fd41-4999-af41-4471dee864be None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:04.109788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb40bca-fd41-4999-af41-4471dee864be None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:04.110069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb40bca-fd41-4999-af41-4471dee864be None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:04.110747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb40bca-fd41-4999-af41-4471dee864be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:04.112238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb40bca-fd41-4999-af41-4471dee864be None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:04.139874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:05.132599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c37e-8580-4c4d-ad99-a61a3f5ece10 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:05.133141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c37e-8580-4c4d-ad99-a61a3f5ece10 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:05.133141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c37e-8580-4c4d-ad99-a61a3f5ece10 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:05.134401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:05.140009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:05.140511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:05.140612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:05.160104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:05.161459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:05.177541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:05.237221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:05.501378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c37e-8580-4c4d-ad99-a61a3f5ece10 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:05.504985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:05.607964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c37e-8580-4c4d-ad99-a61a3f5ece10 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:05.644312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:05.644969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:05.645257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:05.645606 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:05.658135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:05.663277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:05.664188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:05.664949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 26/49] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:05.670761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:05.776608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e6bf-f066-4283-8d15-ccd923f8ec47 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:05.812430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:05.813049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:05.813329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:05.813598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:05.814274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:05.814599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:05.816007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:05.828030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 24/50] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:05.834125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:05.899127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:05.940454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8121-9385-4328-99d1-8523a6452fa7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:05.976257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db233-5c13-4cf9-a384-924d3dfed8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:05.976906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db233-5c13-4cf9-a384-924d3dfed8c6 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:05.977189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db233-5c13-4cf9-a384-924d3dfed8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:05.977459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db233-5c13-4cf9-a384-924d3dfed8c6 None admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:05.978703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db233-5c13-4cf9-a384-924d3dfed8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:05.980218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db233-5c13-4cf9-a384-924d3dfed8c6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:05.981827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 27/51] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:05 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:05.987701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:06.003772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:06.064250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4980-4bd0-435a-b9e9-1150a8c359af None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:06.064437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4980-4bd0-435a-b9e9-1150a8c359af None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:06.064701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4980-4bd0-435a-b9e9-1150a8c359af None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:06.066046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 28/52] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:06.071090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:06.071383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:06.071658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:06.090188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:06.091759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:06.104111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb49a0-9e9a-4ea6-b152-e588d0ec29b7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:06.138283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:06.138952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:06.139236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:06.139512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:06.140630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:06.142134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:06.143778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 25/53] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:06.149601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:06.163288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 29/54] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:06.228446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:06.248546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866133e-e495-40d6-b2f4-6f508f1cadde None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:06.284255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:06.284869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:06.285147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:06.285419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:06.286182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.domain.id=default, user.id=998dc91652fe4a80ad7901f3f3010bad) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:06.286492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:06.287991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:06.295170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 26/55] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Sep 6 11:34:06 2022] GET /identity/v3/role_assignments?user.id=998dc91652fe4a80ad7901f3f3010bad&scope.domain.id=default&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:06.429432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:06.493216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:06.536029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46e39-8b5e-4c88-a200-28efe92dd52e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:06.569612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba692d-240d-41c6-8478-13f312f96e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:06.570247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba692d-240d-41c6-8478-13f312f96e0e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:06.570528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba692d-240d-41c6-8478-13f312f96e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:06.570849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba692d-240d-41c6-8478-13f312f96e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:06.572080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba692d-240d-41c6-8478-13f312f96e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:06.573583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba692d-240d-41c6-8478-13f312f96e0e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:06.575193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 30/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:06.581283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:06.702631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b2692-6546-442a-b4ae-2fa9332ddb98 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:06.740971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b78ca2-f468-4b5f-bc03-b266b2555b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:06.741589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78ca2-f468-4b5f-bc03-b266b2555b2d None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:06.741871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78ca2-f468-4b5f-bc03-b266b2555b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:06.742142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78ca2-f468-4b5f-bc03-b266b2555b2d None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:06.742835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b78ca2-f468-4b5f-bc03-b266b2555b2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:06.744305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b78ca2-f468-4b5f-bc03-b266b2555b2d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:06.761121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:06.778319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 27/57] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Sep 6 11:34:06 2022] POST /identity/v3/projects => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:08.684297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2859e-f762-47fe-a2cb-017f80fd0718 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:08.685148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2859e-f762-47fe-a2cb-017f80fd0718 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:08.685148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2859e-f762-47fe-a2cb-017f80fd0718 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:08.687405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 31/58] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:08.692976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:08.693431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:08.693517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:08.713632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:08.714871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:08.788149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 28/59] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:09.053567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2859e-f762-47fe-a2cb-017f80fd0718 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:09.180524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2859e-f762-47fe-a2cb-017f80fd0718 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:09.210255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:09.225271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818dc1-4e31-4470-a795-b2a953124fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:09.226233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818dc1-4e31-4470-a795-b2a953124fc7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:09.226668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818dc1-4e31-4470-a795-b2a953124fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:09.227121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818dc1-4e31-4470-a795-b2a953124fc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:09.228992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818dc1-4e31-4470-a795-b2a953124fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:09.231161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818dc1-4e31-4470-a795-b2a953124fc7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:09.233666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 32/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:09.239792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:09.342161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec7e4-28fe-4cce-aea9-5c2f0cc089d5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:09.371356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:09.386476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726febe-a768-4128-afaa-82cd13e51a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:09.387476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726febe-a768-4128-afaa-82cd13e51a4e None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:09.387931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726febe-a768-4128-afaa-82cd13e51a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:09.388364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726febe-a768-4128-afaa-82cd13e51a4e None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:09.389436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726febe-a768-4128-afaa-82cd13e51a4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:09.391880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726febe-a768-4128-afaa-82cd13e51a4e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:09.425686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 29/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:09 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:12.500945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9119-3482-421b-94e5-85f8bb621dfa None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:12.501487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9119-3482-421b-94e5-85f8bb621dfa None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:12.501487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9119-3482-421b-94e5-85f8bb621dfa None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:12.502975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 33/62] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:12.510102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dad5-5ed4-414c-998a-8f7ac3af59be None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:12.510614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dad5-5ed4-414c-998a-8f7ac3af59be None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:12.510959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dad5-5ed4-414c-998a-8f7ac3af59be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:12.541421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d643dad5-5ed4-414c-998a-8f7ac3af59be None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:12.542727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d643dad5-5ed4-414c-998a-8f7ac3af59be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:12.641201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 30/63] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:12.685778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adbf1c-1ffa-4e1b-9b7d-ca5927ec8dae None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:12.686089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adbf1c-1ffa-4e1b-9b7d-ca5927ec8dae None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:12.686342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adbf1c-1ffa-4e1b-9b7d-ca5927ec8dae None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:12.688016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 34/64] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:12.693024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:12.693325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:12.693606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:12.718622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:12.719871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:12.741394 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323d54-ee01-47e0-a832-94be97cd80fb None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:12.741722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323d54-ee01-47e0-a832-94be97cd80fb None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:12.741947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323d54-ee01-47e0-a832-94be97cd80fb None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:12.743610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 35/65] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:12.758217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47cb8-d0e3-4254-912a-b619d9c5ec99 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:12.758489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47cb8-d0e3-4254-912a-b619d9c5ec99 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:12.758714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47cb8-d0e3-4254-912a-b619d9c5ec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:12.857475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 31/66] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:12.899796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6ea47cb8-d0e3-4254-912a-b619d9c5ec99 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:12.901057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6ea47cb8-d0e3-4254-912a-b619d9c5ec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:12.957476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.001116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 36/67] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 06 11:34:13.054710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.071249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5e0b-00d3-42de-ad67-84695ff5fe5f None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.071543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5e0b-00d3-42de-ad67-84695ff5fe5f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.071892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5e0b-00d3-42de-ad67-84695ff5fe5f None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.073584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 37/68] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:13.079288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc2061-1ce4-4011-a997-ad3a411a1627 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.079577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc2061-1ce4-4011-a997-ad3a411a1627 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.079861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc2061-1ce4-4011-a997-ad3a411a1627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.119759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f8bc2061-1ce4-4011-a997-ad3a411a1627 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:13.120984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f8bc2061-1ce4-4011-a997-ad3a411a1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:13.134561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df815e3-b4ea-4e23-8fa6-eed0326f2de8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.196259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 38/69] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:13.197482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.198332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.198781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.199211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.210418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:13.215790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:13.216824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:13.217778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:13.219878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 32/70] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:13.225240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f33c-4b21-4061-8334-c6b205095c77 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.225383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.225458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f33c-4b21-4061-8334-c6b205095c77 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.225458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f33c-4b21-4061-8334-c6b205095c77 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.226366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 39/71] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:13.229335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f33c-4b21-4061-8334-c6b205095c77 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.288338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.328051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae72f2-affa-4be8-980b-ae5c8948801b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.329925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.341380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f33c-4b21-4061-8334-c6b205095c77 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.365157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639b3b0-f242-4537-8c9a-1f4ac83ec6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.365810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639b3b0-f242-4537-8c9a-1f4ac83ec6be None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.366093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639b3b0-f242-4537-8c9a-1f4ac83ec6be None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.366363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639b3b0-f242-4537-8c9a-1f4ac83ec6be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.376907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639b3b0-f242-4537-8c9a-1f4ac83ec6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:13.377145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.377757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.378037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.378308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.379001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:13.379304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:13.380770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-3639b3b0-f242-4537-8c9a-1f4ac83ec6be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:13.381904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:13.382736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:13.383527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 33/72] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:13.384243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.384917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.384917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.401054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 40/73] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:13.401054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.406216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:13.407484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:13.489268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 34/74] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:13.490167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.520461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ef16-3665-4410-9c62-5b7f74e7b30e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.541460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.561281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.562028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.562308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.562566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.573148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:13.578136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:13.579002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:13.579760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 41/75] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:13.584480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.597333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.607216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500abf-cabb-495b-a049-7a8914822d17 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.642749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.643451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.643735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.644011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.644677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:13.644985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:13.646469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:13.654821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 35/76] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:13.655614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.692054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a13c0-8206-4d07-b22d-cccf4b6b8cdf None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.731721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.732373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.732660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.732924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.751981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:13.753450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:13.755188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 42/77] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:13.756005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.775797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de214fb3-3314-45b6-91c6-89af5c70a4d8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.790848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.811145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.811791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.812078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.812351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.822795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:13.828087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:13.828991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:13.829963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 36/78] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:13.834932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.850494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:13.859741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba81975-5ace-4609-931b-61cca834e8b7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.892994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.893610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.893896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.894172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.894888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:13.895194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:13.896649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:13.904951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 43/79] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:13.905800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:13.939422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c52881-558e-4b07-86cb-47f0cf709735 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:13.973478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:13.974133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:13.974421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:13.974722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:13.975918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:13.977411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:13.979069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 37/80] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:13.979069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.011258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.015645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9d5b-665f-4d8d-972a-e2f774b1320d None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.050662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.051492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.051785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.052066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.064982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.084382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed3bb-7651-4dda-8f89-be7358a5b70d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.118141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.118813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.119087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.119375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.120493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.121821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.121952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.123330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.123770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 38/81] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:14.124311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.219796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.226129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 44/82] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:14.226640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a3a0-2065-407c-9bce-0d0507202380 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.226883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.266773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.267464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.267742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.268013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.268657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:14.268958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.270382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.278770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 39/83] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:14.279584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.295706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.332495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe92ea-ad1b-481a-b686-4e07bb96bf53 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.367015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.367572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.367948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.368222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.369363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.370853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.372440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 45/84] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:14.373165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.381792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6f5f-bbf6-4b49-abe5-62f8587ef1bf None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.416715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.417371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.417661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.417931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.440116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.474770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0c4b-4a09-40a9-91e2-40c15c322981 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.490116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.491775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.507052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.511184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.511792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.512386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.512651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.513316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.514827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.547956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 46/85] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:14 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:14.549180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.601952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 40/86] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:14.603728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.674017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a113b-3245-4a05-9767-0b767c14dc56 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.701931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.722522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.723291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.723639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.723987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.725202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.726669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.728555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 47/87] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:14.730939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1300-a4df-4286-9636-e8e85e5f7d57 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.731065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.748078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.775068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.775725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.776002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.776267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.777447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.778962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.781092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 41/88] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:14.782252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.851107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760834-5571-4667-864b-9aba3ebea26e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.901451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.902084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.902363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.902633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.909914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bdfa5-e612-4412-a78c-21dc849e93a3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:14.946650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:14.947250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:14.947530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:14.947808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:14.948961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.950480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:14.952268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 42/89] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:14.953062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:14.983165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.997986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:14.999526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.010547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:15.068162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bcdaa-0bc9-4756-b1c1-95a1c9a173ce None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.108033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.108911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.109190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.109462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.110455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=be154751276f477abd85fa8e7f7179c4) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:15.111161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.112625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.120623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 43/90] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/role_assignments?user.id=be154751276f477abd85fa8e7f7179c4&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:15.122083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:15.128339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 48/91] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:15.129364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:15.232770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:15.244689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54036c7-ae32-4a82-97f1-dcbb3403806c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.266324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a428-18bc-44b7-9a31-d4205276f0a6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.286655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.289215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:15.289344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.289540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.289817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.294656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] RBAC: Adding query filter params (role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=be154751276f477abd85fa8e7f7179c4) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:15.294656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.294656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.300042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 49/92] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:15 2022] GET /identity/v3/role_assignments?user.id=be154751276f477abd85fa8e7f7179c4&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=559beb10e54749d1b4ce94120725233a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:15.300989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:15.346092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.351179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.351491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.351952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.425608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0822-46f9-4a8e-bd0c-6bdbbcce500b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.452937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.454911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.468719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.469394 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.469672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.469952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.471743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.473227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.479285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 50/93] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:15 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:15.485242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:15.552518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:15.589227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 44/94] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:15.595297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:15.612200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:15.708053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6719bb-69c1-4ad9-b583-5c1b9fcc6a8c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.728805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122afc5-0028-45d4-a45f-99876731cda3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.746219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.747280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.747733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.748238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] PATH_INFO: `/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.749680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] RBAC: Authorizing `identity:get_project(project_id=0161e0c3770a4eecba9be9cbf0e01cfe)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.751463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.753414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 45/95] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:15 2022] GET /identity/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:15.759319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:15.803485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.804224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.804574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.804911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.805737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=998dc91652fe4a80ad7901f3f3010bad) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:15.806111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.807703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1297a-a2b5-46b4-83ac-fbd9b9fcffb5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.813896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 51/96] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:15 2022] GET /identity/v3/role_assignments?user.id=998dc91652fe4a80ad7901f3f3010bad&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:15.863096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:15.890179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef944d-e0de-4484-8021-6563608abacf None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:15.947115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:15.947841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:15.948128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:15.948406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:15.949178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=0161e0c3770a4eecba9be9cbf0e01cfe, user.id=be154751276f477abd85fa8e7f7179c4) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:15.949494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:15.951061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6399ed-0a38-43b5-9822-6e253c0dc6c0 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:15.962973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 46/97] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:15 2022] GET /identity/v3/role_assignments?user.id=be154751276f477abd85fa8e7f7179c4&scope.project.id=0161e0c3770a4eecba9be9cbf0e01cfe&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:16.946860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4415-d5d7-4fc3-bfee-ecd18d9dc21e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:16.947910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4415-d5d7-4fc3-bfee-ecd18d9dc21e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:16.948414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4415-d5d7-4fc3-bfee-ecd18d9dc21e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:16.950259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 52/98] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:16.956334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea29a1-0be3-4b25-bc9f-3511b6571713 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:16.957256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea29a1-0be3-4b25-bc9f-3511b6571713 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:16.957725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea29a1-0be3-4b25-bc9f-3511b6571713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:16.980083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-90ea29a1-0be3-4b25-bc9f-3511b6571713 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:16.981618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-90ea29a1-0be3-4b25-bc9f-3511b6571713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:17.069072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 47/99] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:17.364374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0be4-cbf4-4cbe-a459-7f493c16e15f None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:17.364743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0be4-cbf4-4cbe-a459-7f493c16e15f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:17.364919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0be4-cbf4-4cbe-a459-7f493c16e15f None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:17.366422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 53/100] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:17.379904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:17.380497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:17.380968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:17.400367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:17.401929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:17.482153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 48/101] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:17.642784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0be4-cbf4-4cbe-a459-7f493c16e15f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:17.736551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:17.762142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0be4-cbf4-4cbe-a459-7f493c16e15f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:17.797807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f886d8-4e73-4bf4-93f4-e83632b228ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:17.798474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f886d8-4e73-4bf4-93f4-e83632b228ed None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:17.798778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f886d8-4e73-4bf4-93f4-e83632b228ed None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:17.799061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f886d8-4e73-4bf4-93f4-e83632b228ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:17.810629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f886d8-4e73-4bf4-93f4-e83632b228ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-83f886d8-4e73-4bf4-93f4-e83632b228ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:17.815596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:17.816495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:17.817248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:17.823081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 54/102] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:17.824683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:17.851925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:17.958095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0167d6f-3d62-4870-b1bc-a357d063bc3a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:18.003450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb080754-50e9-4614-ad27-b5560dd8aab2 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.003980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb080754-50e9-4614-ad27-b5560dd8aab2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.003980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb080754-50e9-4614-ad27-b5560dd8aab2 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.005390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 55/103] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:18.007689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:18.008364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.008644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.008915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.009594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:18.009896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:18.011334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:18.020049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.020330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.020605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.027328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 49/104] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:18.028556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:18.061461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:18.062713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:18.127064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:18.175772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9df7-b0ab-4da6-b36e-a2ac027d7298 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:18.186857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 56/105] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:18.188201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:18.229329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:18.229904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.230187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.230467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.233499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:18.235626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:18.237488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 50/106] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:18.244352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:18.347063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:18.387731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f336e6-e129-4708-852c-8a7e632949ea None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:18.440651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d71dd-c30b-42fa-850e-e34de8e59744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:18.442337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d71dd-c30b-42fa-850e-e34de8e59744 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.443058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d71dd-c30b-42fa-850e-e34de8e59744 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.444691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d71dd-c30b-42fa-850e-e34de8e59744 None admin] PATH_INFO: `/v3/users/837d52ca516b40b398983d84aaf29408` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.458268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49c94-056f-4ce4-8bf2-c6dfac2161e8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:18.470679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d71dd-c30b-42fa-850e-e34de8e59744 None admin] RBAC: Authorizing `identity:get_user(user_id=837d52ca516b40b398983d84aaf29408)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:18.474365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d71dd-c30b-42fa-850e-e34de8e59744 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:18.482093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 57/107] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:18 2022] GET /identity/v3/users/837d52ca516b40b398983d84aaf29408 => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:18.482093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdd530-eb41-4a13-a91b-4cbf1293bb2a None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.482093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdd530-eb41-4a13-a91b-4cbf1293bb2a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.482093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdd530-eb41-4a13-a91b-4cbf1293bb2a None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.482093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 58/108] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:18.490888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.491175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.491458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.513037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:18.514055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.514552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.515036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.515941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:18.517654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:18.523004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:18.527727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:18.528953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:18.558786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 51/109] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:34:18 2022] POST /identity/v3/projects => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:18.561650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:18.651032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 59/110] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:18.658788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:18.778782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13ef83-091a-4e94-a907-e3fc86db83fb None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:18.784219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:18.822393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac626-5d0b-4457-abd0-9e716e4fec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:18.823073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac626-5d0b-4457-abd0-9e716e4fec65 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.823409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac626-5d0b-4457-abd0-9e716e4fec65 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.823700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac626-5d0b-4457-abd0-9e716e4fec65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.834714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e92ed-2a03-4208-bf62-3446d12dc15e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:18.878132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9d839-d3b7-43f6-a407-1398bffdee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:18.878818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9d839-d3b7-43f6-a407-1398bffdee21 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.879103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9d839-d3b7-43f6-a407-1398bffdee21 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.879376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9d839-d3b7-43f6-a407-1398bffdee21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.889164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:18.891908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9d839-d3b7-43f6-a407-1398bffdee21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-21f9d839-d3b7-43f6-a407-1398bffdee21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:18.897364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:18.898250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:18.899937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 60/111] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:18.900572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef3180-f52d-4807-b1da-104ca651ef80 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:18.900572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef3180-f52d-4807-b1da-104ca651ef80 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:18.900692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef3180-f52d-4807-b1da-104ca651ef80 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:18.901900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 61/112] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:18.905613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef3180-f52d-4807-b1da-104ca651ef80 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:18.908668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac626-5d0b-4457-abd0-9e716e4fec65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:18.910383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac626-5d0b-4457-abd0-9e716e4fec65 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.014165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 52/113] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:19.016324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.016846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.017333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.035921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:19.037464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:19.070187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef3180-f52d-4807-b1da-104ca651ef80 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.108211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:19.111354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 53/114] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:19.120021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.121565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.122439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.122965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.123430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.124297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:19.124812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:19.126403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86a3a8-98ec-4e8e-b8aa-ac138fe0067a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.135848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 62/115] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:19.137329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd55c-af38-461c-99ff-bbd25dc95d19 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.137809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd55c-af38-461c-99ff-bbd25dc95d19 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.138318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd55c-af38-461c-99ff-bbd25dc95d19 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.139756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 63/116] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:19.140656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecd55c-af38-461c-99ff-bbd25dc95d19 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.159353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:19.250415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecd55c-af38-461c-99ff-bbd25dc95d19 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.255872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912f16-ab2a-4f8f-b0f3-58e5eb75dbe1 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.291177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17913d-8d2b-47b8-a9b7-06346d3687dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.292092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17913d-8d2b-47b8-a9b7-06346d3687dd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.292605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17913d-8d2b-47b8-a9b7-06346d3687dd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.293072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17913d-8d2b-47b8-a9b7-06346d3687dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.302568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.303259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.303544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.303823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.304994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:19.306383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17913d-8d2b-47b8-a9b7-06346d3687dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:19.306842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.308870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 54/117] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:19.309671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-4c17913d-8d2b-47b8-a9b7-06346d3687dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:19.313131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:19.313969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:19.314759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:19.317199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 64/118] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:19.318893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.319433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.319933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.339810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:19.341380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:19.393366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:19.423988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 65/119] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:19.425303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.439916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce280471-9531-4c5a-bb2c-2be20918eb61 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.443253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:19.484734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.485559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.485935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.486716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.488197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:19.490046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.491977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 55/120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:19.492910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.610653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271669d-ace6-4469-8647-f53971792ad5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.647608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977cac-ffba-4b8f-9dca-94a91ff3260c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.648473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.649204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.649584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.649960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.650766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:19.651175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:19.652687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.661552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 56/121] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:19.662489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.684614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:19.693898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.695031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.695478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.696145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.697442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] RBAC: Adding query filter params (role.id=ed7acc5f358e4c8fac6cc2abe37ee56d, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=837d52ca516b40b398983d84aaf29408) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:19.698157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:19.700446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.708876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 66/122] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/role_assignments?user.id=837d52ca516b40b398983d84aaf29408&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=ed7acc5f358e4c8fac6cc2abe37ee56d => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:19.709855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.766435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:19.801066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2f78-8ff4-480d-8285-8a2aec789fe6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.830020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f182d-e3a3-4e81-8383-75cc4dd9e3b6 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:19.850430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.852618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.854091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.854797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.858849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:19.860618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:19.862661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 57/123] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:19.868089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.893885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:19.895100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:19.895618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:19.896156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:19.916499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:19.927683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:19.928703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:19.929467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:19.930061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 67/124] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:19.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:19.978734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:20.002324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c17ba-c344-48ef-b5ca-b89999df1076 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.039191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.039882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.040109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.040370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.041622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.043250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.044869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 58/125] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:20.050483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.079978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:20.084436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f260e99-851f-4ba8-9a53-82fe2f5000ae None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.128549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.130118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.130704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.131442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.146228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:20.153543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:20.154430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:20.155552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:20.158518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 68/126] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:20.160050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.187380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920b74c-22f1-4115-810b-cbb4e2fde0f9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.235499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.236619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.236904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.237183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387/users/be154751276f477abd85fa8e7f7179c4/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.240216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f98a274c514a69adb9c210ec141387, user_id=be154751276f477abd85fa8e7f7179c4, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.242080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.260553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 59/127] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:20 2022] PUT /identity/v3/projects/f2f98a274c514a69adb9c210ec141387/users/be154751276f477abd85fa8e7f7179c4/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:20.261319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.287048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:20.319163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7623d-5f9f-472e-9ab1-1c23ddf5d088 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.374598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.375319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.375852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.376225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.377070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:20.377577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.379428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.389501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 69/128] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:20.393774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.435079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:20.489265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d714a0-ad48-40d6-b036-4b73086bcff3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.503894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ca19-e2f5-4e65-a1cd-92f173028d2e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.527550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.528465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.528954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.529361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.530927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.532923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.534898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 60/129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:20 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:20.536174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.542228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.542919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.543208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.543488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.544171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:20.544486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.545884 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.555326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 70/130] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:20.556231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.645603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b74c0-e753-49d2-911a-868907fb3044 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.664839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:20.683040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.684040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.684507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.685012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.686496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f775de6-c275-40f1-86e0-c8b191c67ac5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.686800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.688483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.690556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 61/131] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:20 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:20.690949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:20.692463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.734748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.734958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.735221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.735377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387/users/be154751276f477abd85fa8e7f7179c4/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.737647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f98a274c514a69adb9c210ec141387, user_id=be154751276f477abd85fa8e7f7179c4, role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.746085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.773279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 71/132] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:20 2022] PUT /identity/v3/projects/f2f98a274c514a69adb9c210ec141387/users/be154751276f477abd85fa8e7f7179c4/roles/559beb10e54749d1b4ce94120725233a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:20.774142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:20.915878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8d2c-0a33-4711-8784-64b30ff42cd3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:20.991117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:20.991587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:20.991869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:20.992143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:20.996618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:20.998241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:20.999957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 62/133] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:20 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:21.001929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c683e-51e3-4a22-8a0b-6b04f2d511f1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:21.010508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:21.038330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:21.044827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:21.045702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:21.046111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:21.046548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:21.053802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:21.058053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:21.060666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 72/134] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:20 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:21.067351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:21.095869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:21.192843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373ccf8-8674-4437-ba08-d8e89866529b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:21.235718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:21.236373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:21.236652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:21.236931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] PATH_INFO: `/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:21.238080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] RBAC: Authorizing `identity:get_project(project_id=0161e0c3770a4eecba9be9cbf0e01cfe)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:21.240907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:21.242735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 63/135] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:21 2022] GET /identity/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:21.251800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:21.281058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf8516-5eb7-46ef-abcc-6a73b3510865 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:21.318925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2da27-5799-4c0b-bab1-523200bd5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:21.319617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2da27-5799-4c0b-bab1-523200bd5d53 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:21.319899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2da27-5799-4c0b-bab1-523200bd5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:21.320171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2da27-5799-4c0b-bab1-523200bd5d53 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387/users/998dc91652fe4a80ad7901f3f3010bad/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:21.322215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2da27-5799-4c0b-bab1-523200bd5d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f98a274c514a69adb9c210ec141387, user_id=998dc91652fe4a80ad7901f3f3010bad, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:21.323841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2da27-5799-4c0b-bab1-523200bd5d53 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:21.340380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 73/136] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:21 2022] PUT /identity/v3/projects/f2f98a274c514a69adb9c210ec141387/users/998dc91652fe4a80ad7901f3f3010bad/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:21.431302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:21.456590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d38d3-1dff-4e5f-a6a2-74fc3861b085 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:21.502138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1b350-761d-4e06-aac9-2d8a3d4bf4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:21.502881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1b350-761d-4e06-aac9-2d8a3d4bf4e3 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:21.503170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1b350-761d-4e06-aac9-2d8a3d4bf4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:21.503452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1b350-761d-4e06-aac9-2d8a3d4bf4e3 None admin] PATH_INFO: `/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe/users/be154751276f477abd85fa8e7f7179c4/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:21.505581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1b350-761d-4e06-aac9-2d8a3d4bf4e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0161e0c3770a4eecba9be9cbf0e01cfe, user_id=be154751276f477abd85fa8e7f7179c4, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:21.507135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1b350-761d-4e06-aac9-2d8a3d4bf4e3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:21.530149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 64/137] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:21 2022] PUT /identity/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe/users/be154751276f477abd85fa8e7f7179c4/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:21.672623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b221-3553-4cb6-bcb7-84197847d352 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:21.672979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b221-3553-4cb6-bcb7-84197847d352 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:21.673263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b221-3553-4cb6-bcb7-84197847d352 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:21.674664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 74/138] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:21.680571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7ec92-7800-4613-a889-6145bcd93c0f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:21.680874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7ec92-7800-4613-a889-6145bcd93c0f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:21.681136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7ec92-7800-4613-a889-6145bcd93c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:21.707918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-65e7ec92-7800-4613-a889-6145bcd93c0f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:21.712165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-65e7ec92-7800-4613-a889-6145bcd93c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:21.794242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 65/139] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:22.060403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e78b-8684-47ae-8924-484e6c57785f None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:22.061068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e78b-8684-47ae-8924-484e6c57785f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:22.061562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e78b-8684-47ae-8924-484e6c57785f None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:22.063195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 75/140] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:22.069504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:22.070079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:22.070553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:22.090157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:22.091764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:22.169715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 66/141] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:22.322974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e78b-8684-47ae-8924-484e6c57785f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:22.419197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:22.456350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e78b-8684-47ae-8924-484e6c57785f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:22.493816 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:22.494866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:22.495348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:22.495814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:22.497162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:22.498942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:22.500752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 76/142] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:22.506370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:22.510437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:22.646876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dbe68-0c41-4eb4-b0d8-87e7f37e8f32 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:22.690303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:22.691385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:22.691864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:22.692348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:22.693297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:22.695029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:22.714255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:22.741780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 67/143] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:22 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:22.874274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ab96-9f7d-4634-951f-d464abc105ca None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:22.926140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222acda-d8ad-49d1-99c2-7147ab1740e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:22.926858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222acda-d8ad-49d1-99c2-7147ab1740e1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:22.927252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222acda-d8ad-49d1-99c2-7147ab1740e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:22.927527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222acda-d8ad-49d1-99c2-7147ab1740e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:22.937769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:22.941752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222acda-d8ad-49d1-99c2-7147ab1740e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-4222acda-d8ad-49d1-99c2-7147ab1740e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:22.951598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:22.952514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:22.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:22.956111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 77/144] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:22.961985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.066637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:23.113514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495c861-aa26-4669-b9b4-c63098360349 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.114162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495c861-aa26-4669-b9b4-c63098360349 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.114677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495c861-aa26-4669-b9b4-c63098360349 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.116873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 78/145] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:23.128160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.128756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.129251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.131604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730032b-fb37-4a06-961d-b9779548faf9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.165312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:23.170258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:23.173494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.174129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.174406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.174676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.176437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:23.176688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:23.178202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:23.188530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 68/146] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:23.194673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.291736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 79/147] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:23.335243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35339c4b-7702-4737-8956-503d98316d17 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.366939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:23.389250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.389919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.390197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.390467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] PATH_INFO: `/v3/users/837d52ca516b40b398983d84aaf29408` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.391723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] RBAC: Authorizing `identity:get_user(user_id=837d52ca516b40b398983d84aaf29408)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:23.393355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:23.395048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 69/148] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:23 2022] GET /identity/v3/users/837d52ca516b40b398983d84aaf29408 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:23.400983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.532626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4bd59-3a5c-4f3c-bf67-8d8133473676 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.571309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:23.580075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.580730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.581014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.581289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.582444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:23.584015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:23.585993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 80/149] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:23 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:23.591892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.650671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.755230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee204f-cb19-482a-882c-2e12a4d94131 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.830254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.830904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.831180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.831449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387/users/837d52ca516b40b398983d84aaf29408/roles/ed7acc5f358e4c8fac6cc2abe37ee56d` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.835652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f98a274c514a69adb9c210ec141387, user_id=837d52ca516b40b398983d84aaf29408, role_id=ed7acc5f358e4c8fac6cc2abe37ee56d)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:23.837138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:23.844286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45c030-4dc0-4d79-a619-951ea6e74551 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.866086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 70/150] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:23 2022] PUT /identity/v3/projects/f2f98a274c514a69adb9c210ec141387/users/837d52ca516b40b398983d84aaf29408/roles/ed7acc5f358e4c8fac6cc2abe37ee56d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:23.900743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59676a4-6fa1-4630-9773-1f5ab54a4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.901398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59676a4-6fa1-4630-9773-1f5ab54a4d7a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.901675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59676a4-6fa1-4630-9773-1f5ab54a4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.901954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59676a4-6fa1-4630-9773-1f5ab54a4d7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.918903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59676a4-6fa1-4630-9773-1f5ab54a4d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-a59676a4-6fa1-4630-9773-1f5ab54a4d7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:23.923861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:23.924723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:23.925929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 81/151] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:23.931151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.933476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbe065-d003-4729-838f-83f6505b81d9 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.933760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbe065-d003-4729-838f-83f6505b81d9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.934029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbe065-d003-4729-838f-83f6505b81d9 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.935426 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 82/152] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:23.941677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.941980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.942225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.975805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:23.977069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.016058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:24.070351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79db7-4000-4bee-a41f-d7b4aa579c77 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.111513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.112064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.112350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.112628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.113316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:24.113627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.118052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.127607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 71/153] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:24.136344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:24.136631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.208112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 83/154] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:24.256791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde596c4-7c3e-4428-b01d-02de323e2e87 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.271612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:24.300425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef13db3-9bb7-428f-b84d-e1b42a6ad6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.301093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef13db3-9bb7-428f-b84d-e1b42a6ad6c7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.301380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef13db3-9bb7-428f-b84d-e1b42a6ad6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.301654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef13db3-9bb7-428f-b84d-e1b42a6ad6c7 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.302979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef13db3-9bb7-428f-b84d-e1b42a6ad6c7 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.304411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef13db3-9bb7-428f-b84d-e1b42a6ad6c7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.306261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 72/155] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:24.312124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.474386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551a48-fe54-4c41-9435-9d4afa6a4f6b None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.474736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551a48-fe54-4c41-9435-9d4afa6a4f6b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.475008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551a48-fe54-4c41-9435-9d4afa6a4f6b None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.476590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 73/156] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:24.484318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b787b-e58b-419f-acf4-5499e1b5b282 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.484614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b787b-e58b-419f-acf4-5499e1b5b282 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.484886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b787b-e58b-419f-acf4-5499e1b5b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.526667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-c95b787b-e58b-419f-acf4-5499e1b5b282 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:24.531125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c95b787b-e58b-419f-acf4-5499e1b5b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.549707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541875aa-6ea3-4554-bfcc-05fb9d005f30 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.687451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.688104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.688378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.690958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.703016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 74/157] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:24.815112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22969-bcb2-4cca-8996-1cb5dcbe71ad None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.815112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22969-bcb2-4cca-8996-1cb5dcbe71ad None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.815112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22969-bcb2-4cca-8996-1cb5dcbe71ad None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.815982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 75/158] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:24.827630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.827946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.828181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.846853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:24.863870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:24.865331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.874722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.874722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.978712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 76/159] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:24.978712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.034851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 84/160] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:25.042568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.047100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:25.121389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd13e-8bb0-4bff-ad76-a9313415dda8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.174921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.175580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.175857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.176124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.192370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:25.197809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:25.198713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:25.199533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 77/161] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:25.206715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.219073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:25.236208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3c05b-8e76-4353-af58-60379c488583 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.331439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.332139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.332412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.332679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.335513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:25.337008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:25.339128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 85/162] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:25.361454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:25.365484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.367997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a8112-4d66-44c2-8722-3cf592adab8f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.432546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.433197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.433476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.433747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.434443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:25.434778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:25.436227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:25.450368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 78/163] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:25.456055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.585004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92d96-118f-4399-92d2-7eb431857bdc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.631474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.632116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.632395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.632666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.633415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=be154751276f477abd85fa8e7f7179c4) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:25.633734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:25.637587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:25.646093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 86/164] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/role_assignments?user.id=be154751276f477abd85fa8e7f7179c4&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:25.646792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.691359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:25.729142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c98e75-7fbb-4f1c-9fc0-4353cfcc976d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.841766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4546ba3-94c7-487c-980d-19cf64ec8b63 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.854555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.855563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.856055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.856515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.857880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:25.859585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:25.861719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 79/165] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:25.866910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.877974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.878941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.879388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.879826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.891507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:25.897367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:25.898449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:25.899699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:25.901685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 87/166] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:25.902654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:25.931718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:25.997405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:26.008948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d636a-f6c8-4811-a3ef-92093ec994a6 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:26.056204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:26.057121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:26.057540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:26.057943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:26.135957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035efb80-4b64-4241-b8af-fbe380d93ae9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:26.196594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:26.198122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:26.229578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:26.230246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:26.230521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:26.230818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:26.257240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:26.262536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:26.263487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:26.264363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:26.267793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 80/167] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:26.268597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:26.358766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 88/168] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:26.359289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:26.362381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:26.439252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:26.456099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940c80-dfd6-4153-82e0-02f0038af60f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:26.520017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdcb4e-fb8e-4cfb-8dec-bdf1189859bf None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:26.523980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:26.524618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:26.524899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:26.525172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:26.525857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:26.526160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:26.530807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:26.549870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 81/169] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:26.550807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:26.577018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:26.577994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:26.578461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:26.578951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:26.579839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:26.580371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:26.582058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:26.597438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 89/170] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:26.599114 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:26.713763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:26.730960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030bb4-726a-45d1-ac0b-b33f858ed979 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:26.815935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:26.816761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:26.817050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:26.817331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:26.818798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:26.820359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:26.822032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 82/171] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:26 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:26.822831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:26.879080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:26.891367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19000a9b-4203-4fdb-a2dd-91290f912889 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:26.978077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:26.978765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:26.979051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:26.979324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] PATH_INFO: `/v3/users/998dc91652fe4a80ad7901f3f3010bad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:26.981152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] RBAC: Authorizing `identity:get_user(user_id=998dc91652fe4a80ad7901f3f3010bad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:26.982623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:26.984266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 90/172] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:26 2022] GET /identity/v3/users/998dc91652fe4a80ad7901f3f3010bad => generated 247 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:26.985037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:27.063292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b538ed4-f893-4bbd-bdff-30cb71dc764e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:27.127250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:27.128045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.128420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.128802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] PATH_INFO: `/v3/users/be154751276f477abd85fa8e7f7179c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.130836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=be154751276f477abd85fa8e7f7179c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:27.133013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:27.137261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 83/173] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:26 2022] GET /identity/v3/users/be154751276f477abd85fa8e7f7179c4 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:27.146319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:27.213529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f6e2d-8083-48b2-8a9c-c286e4af3fac None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:27.238771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:27.290235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:27.295638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:27.296324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.296632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.296908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.297657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] RBAC: Adding query filter params (role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=be154751276f477abd85fa8e7f7179c4) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:27.297963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:27.303557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09316dd-25a2-4a5d-97c4-9d37580902ee None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:27.309351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c923-7296-48b1-8a4b-4e5cee572cc5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:27.317573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 91/174] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:26 2022] GET /identity/v3/role_assignments?user.id=be154751276f477abd85fa8e7f7179c4&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=559beb10e54749d1b4ce94120725233a => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:27.318980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff61e-56bc-44b5-af50-df9ef1fcff13 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.319268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff61e-56bc-44b5-af50-df9ef1fcff13 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.319542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff61e-56bc-44b5-af50-df9ef1fcff13 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.322834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 92/175] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:27.323929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ff61e-56bc-44b5-af50-df9ef1fcff13 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:27.354323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e26f7-4065-405a-9cba-f2fe32ad73b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:27.355027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e26f7-4065-405a-9cba-f2fe32ad73b1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.355539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e26f7-4065-405a-9cba-f2fe32ad73b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.355825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e26f7-4065-405a-9cba-f2fe32ad73b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.462482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ff61e-56bc-44b5-af50-df9ef1fcff13 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:27.488977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e26f7-4065-405a-9cba-f2fe32ad73b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:27.490583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e26f7-4065-405a-9cba-f2fe32ad73b1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:27.519063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ba07c-54bf-44ae-8daf-ce1251667a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:27.519759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ba07c-54bf-44ae-8daf-ce1251667a8e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.520355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ba07c-54bf-44ae-8daf-ce1251667a8e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.520730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ba07c-54bf-44ae-8daf-ce1251667a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.573284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:27.605935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:27.606355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ba07c-54bf-44ae-8daf-ce1251667a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:27.608071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ba07c-54bf-44ae-8daf-ce1251667a8e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:27.621517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 84/176] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:27.623298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22461a-d798-4ced-a79d-7bc62b598d02 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.623798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22461a-d798-4ced-a79d-7bc62b598d02 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.624260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22461a-d798-4ced-a79d-7bc62b598d02 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.625664 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 85/177] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:27.626611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d99e63-5eac-439e-bbb7-10940193b341 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.626931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d99e63-5eac-439e-bbb7-10940193b341 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.627204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d99e63-5eac-439e-bbb7-10940193b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.649272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b5d99e63-5eac-439e-bbb7-10940193b341 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:27.650482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b5d99e63-5eac-439e-bbb7-10940193b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:27.711477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 93/178] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:27.712738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517be8-987c-4e88-9d47-b5d639ce5702 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.713019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517be8-987c-4e88-9d47-b5d639ce5702 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.713364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28517be8-987c-4e88-9d47-b5d639ce5702 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.714975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 94/179] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:27.715971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703beb0-9f81-49aa-be4d-74fcdf8aab62 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.716316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703beb0-9f81-49aa-be4d-74fcdf8aab62 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.716593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703beb0-9f81-49aa-be4d-74fcdf8aab62 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.717834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 95/180] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:27.718568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703beb0-9f81-49aa-be4d-74fcdf8aab62 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:27.725978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 86/181] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:27.727309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.727589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.727859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.748884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:27.750203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:27.806309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:27.827987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 87/182] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:27.836815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703beb0-9f81-49aa-be4d-74fcdf8aab62 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:27.839628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:27.882248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78beff6-543f-41b7-a228-b15ec3172d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:27.883415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78beff6-543f-41b7-a228-b15ec3172d89 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.883944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78beff6-543f-41b7-a228-b15ec3172d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.884432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78beff6-543f-41b7-a228-b15ec3172d89 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.885832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78beff6-543f-41b7-a228-b15ec3172d89 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:27.887668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78beff6-543f-41b7-a228-b15ec3172d89 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:27.889702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 96/183] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:27 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:27.891198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11aca-ad5a-4254-a431-f0ddcdcdd9d2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:27.891696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11aca-ad5a-4254-a431-f0ddcdcdd9d2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:27.892186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11aca-ad5a-4254-a431-f0ddcdcdd9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:27.911708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:27.917728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-98d11aca-ad5a-4254-a431-f0ddcdcdd9d2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:27.919012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-98d11aca-ad5a-4254-a431-f0ddcdcdd9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:27.989989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f02ba8-7abd-4f46-a1f7-c7b73038b306 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.006926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 97/184] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:28.016647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.017677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.018417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.028100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.029538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.029538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.029538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] PATH_INFO: `/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.030483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] RBAC: Authorizing `identity:get_project(project_id=0161e0c3770a4eecba9be9cbf0e01cfe)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.031980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.038752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 88/185] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:27 2022] GET /identity/v3/projects/0161e0c3770a4eecba9be9cbf0e01cfe => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:28.039634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.042717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:28.045198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:28.128376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 98/186] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:28.139233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.139233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.159080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e89ca0-03db-44a8-b049-b3b177a005ee None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.176996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.203754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.204378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.204867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.205148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.205882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=998dc91652fe4a80ad7901f3f3010bad) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:28.206233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.208273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.216505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 89/187] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/role_assignments?user.id=998dc91652fe4a80ad7901f3f3010bad&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:28.217482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.263346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342456d5-8b4c-48dc-a765-3ad921970d5b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.328429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.329101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.329381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.329652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.341866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:28.347287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:28.348270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:28.349169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 99/188] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:28.349874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.361652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07f520-9407-4fe9-8f61-09628d6c2406 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.401301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.402194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.402787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.403217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.404240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=0161e0c3770a4eecba9be9cbf0e01cfe, user.id=be154751276f477abd85fa8e7f7179c4) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:28.404770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.406277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.422730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 90/189] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/role_assignments?user.id=be154751276f477abd85fa8e7f7179c4&scope.project.id=0161e0c3770a4eecba9be9cbf0e01cfe&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:28.422730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.445528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.489633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.497526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6048-ed68-4f34-aa1e-b4126c642b6c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.549031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.550096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.550532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.550977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.563252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:28.567779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80faf17-37f4-4b6d-bf05-56b5f7230897 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:28.568824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:28.569820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:28.570730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:28.572083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 100/190] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:28.577907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.616520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.617215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.617485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.617755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.619450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.620717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.623215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 91/191] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:28.624513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.700602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528904-2b0b-4173-b84e-00f22adfd8d8 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.724815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.733172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571b77e-52c9-48bc-a0e9-dc3e79b6dcbe None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.737141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.737760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.738068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.738339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.739053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:28.739397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.740936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.743918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.750106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 101/192] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:28.750971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.774286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.774961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.775250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.775503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.786067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:28.791441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:28.792545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:28.793330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 92/193] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:28.793989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.854316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf0a4c-0be7-4aeb-9814-5310a970b71b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.888196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.888800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.889057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.889328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.889993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:28.890295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.891716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.892591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec1825-8356-451a-b1bf-808f272d55f1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:28.900412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 102/194] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:28.901249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.930530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:28.931187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:28.931471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:28.931739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:28.932400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:28.933902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:28.969519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 93/195] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:28 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:28.969519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:28.969822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:28.993269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.053825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc310-b685-4349-ae7c-e32c2f4c9529 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.079817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a1621-a2fa-4364-8a0d-7b05f772fe82 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.094202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.095105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.095488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.095854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] PATH_INFO: `/v3/users/837d52ca516b40b398983d84aaf29408` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.097666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] RBAC: Authorizing `identity:get_user(user_id=837d52ca516b40b398983d84aaf29408)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.099405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.101206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 103/196] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/users/837d52ca516b40b398983d84aaf29408 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:29.101820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.118825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.119309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.119582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.119848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.120523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:29.121040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.122253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.132199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 94/197] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:29.132968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.227491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b17b-f8d2-4517-9f56-61f64138970a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.245702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.247535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.260845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676efd6-7a46-4bfd-85dc-c15bf929fea1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.275312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.275312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.275638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.275882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] PATH_INFO: `/v3/users/d7f28dc4e3cc451c9aaadcfaba594685` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.291493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] RBAC: Authorizing `identity:get_user(user_id=d7f28dc4e3cc451c9aaadcfaba594685)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.292979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.294842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 104/198] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/users/d7f28dc4e3cc451c9aaadcfaba594685 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:29.295708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.302959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.303587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.303860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.304127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.376233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.378087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.415578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753827d-9e3b-447a-853d-8391ab547db3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.455362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.456023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.456297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.456570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] PATH_INFO: `/v3/users/d7f28dc4e3cc451c9aaadcfaba594685` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.457734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] RBAC: Authorizing `identity:get_user(user_id=d7f28dc4e3cc451c9aaadcfaba594685)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.459558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.461497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 105/199] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/users/d7f28dc4e3cc451c9aaadcfaba594685 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:29.462784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.474374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.489620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 95/200] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:29.490853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.523658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.591791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f028-602a-4001-a780-67049a1c4c9e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.596955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caf59a-8a7d-4e7b-9b3e-de450295780b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:29.632305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.632853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.633133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.633407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.641162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:29.642162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:29.643075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:29.643350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:29.719333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.720849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.731218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.748787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:29.751166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:29.776168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.863342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 106/201] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:29.864771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.878646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 96/202] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:29.880376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:29.982218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:29.997373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12c3fd-9614-4359-86fc-616741fe3ca8 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:30.001308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379fc90-7005-42db-8399-1fd186f087b7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:30.033825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:30.034869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:30.035182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:30.035450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:30.036905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:30.038532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:30.045528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 107/203] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:30.045528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:30.053496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:30.054385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:30.054875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:30.055414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:30.056739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:30.057855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:30.060299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:30.062506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 97/204] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:29 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:30.063551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:30.175225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51ba6-3262-4cc9-827c-d69f8905c935 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:30.192939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede338-502a-49bb-acce-9cfcaad44c69 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:30.215200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:30.215882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:30.216216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:30.216492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:30.217640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:30.219246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:30.221264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 108/205] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:30 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:30.222049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:30.239862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:30.241677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:30.242217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:30.242740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:30.244528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] RBAC: Adding query filter params (role.id=ed7acc5f358e4c8fac6cc2abe37ee56d, scope.project.id=f2f98a274c514a69adb9c210ec141387, user.id=837d52ca516b40b398983d84aaf29408) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:30.245106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:30.247497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:30.256648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 98/206] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:30 2022] GET /identity/v3/role_assignments?user.id=837d52ca516b40b398983d84aaf29408&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=ed7acc5f358e4c8fac6cc2abe37ee56d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:30.257851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:30.288798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:30.383324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dbdb1-4de1-4481-b911-14c72ec71012 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:30.425864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:30.427513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:30.428258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:30.428731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:30.429703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:30.431627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] RBAC: Adding query filter params (role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=d7f28dc4e3cc451c9aaadcfaba594685) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:30.432179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:30.434961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f98fe-65b1-4198-9976-9738cd3aae45 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:30.442014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 99/207] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:30 2022] GET /identity/v3/role_assignments?user.id=d7f28dc4e3cc451c9aaadcfaba594685&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=559beb10e54749d1b4ce94120725233a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:30.492982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3be5-cff5-4033-8d96-9f426244ff72 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:30.539813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:30.540452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:30.540726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:30.541053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:30.541954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=d7f28dc4e3cc451c9aaadcfaba594685) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:30.542270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:30.543798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16454259-54ce-410e-8ceb-37bd709bf244 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:30.550746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 109/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:30 2022] GET /identity/v3/role_assignments?user.id=d7f28dc4e3cc451c9aaadcfaba594685&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:31.117017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709dbf-325c-4ac7-85d2-89d7f93defce None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.117572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709dbf-325c-4ac7-85d2-89d7f93defce None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.117844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709dbf-325c-4ac7-85d2-89d7f93defce None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.119523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 100/209] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:31.124876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.125354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.125668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.142468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0322-4b7e-4ddc-949d-8b7870f29af7 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.142780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0322-4b7e-4ddc-949d-8b7870f29af7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.143059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0322-4b7e-4ddc-949d-8b7870f29af7 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.144422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 101/210] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:31.146029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:31.147328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:31.149870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.150155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.150434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.168732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:31.169942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:31.226357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 110/211] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:31.252930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 102/212] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:31.489570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:31.528769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:31.549288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:31.568965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:31.615901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a9a85-528e-45ce-a3f9-6082606d29a7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:31.645947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2879f4-7463-41e0-a213-c0d6fb3dc880 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:31.665799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:31.666451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.666747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.667013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.683036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:31.684440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:31.685114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.685392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.685661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.686928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:31.688129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:31.689016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:31.690031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:31.691306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:31.691388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 111/213] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:31.691455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 103/214] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:31.695925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:31.697297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:31.797937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:31.819576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5324a-f9d9-4927-af47-34e5675474d3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:31.833679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c1cf-a23d-4bc2-a6c2-e5011fd59ab9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:31.865114 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:31.868432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:31.869304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.869582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.869850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.870526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:31.870866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:31.872270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:31.872801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:31.873651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:31.874026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:31.874420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:31.875271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:31.876836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:31.881104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 104/215] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:31.891858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:31.901863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 112/216] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:31 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:32.010902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc80ab-e839-4816-b4af-f6a9e6e0ed73 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.054379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.055228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.055582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.055860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] PATH_INFO: `/v3/users/eb559727f57f499b96c7bc4692cd8826` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.073825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] RBAC: Authorizing `identity:get_user(user_id=eb559727f57f499b96c7bc4692cd8826)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.075350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:32.077248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 105/217] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:31 2022] GET /identity/v3/users/eb559727f57f499b96c7bc4692cd8826 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:32.084021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:32.191923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe0fcd-0d57-4810-ae9f-8cd0b6f70969 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.230111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501039a1-844d-43f1-ade5-76884602590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.230767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501039a1-844d-43f1-ade5-76884602590e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.231032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501039a1-844d-43f1-ade5-76884602590e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.231304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501039a1-844d-43f1-ade5-76884602590e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.290297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:32.308735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501039a1-844d-43f1-ade5-76884602590e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.310561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501039a1-844d-43f1-ade5-76884602590e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:32.440359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 113/218] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:32.445924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:32.449602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:32.494065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0116b8-34cb-4914-9e7d-27d35e42c74b None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.494400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0116b8-34cb-4914-9e7d-27d35e42c74b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.494577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0116b8-34cb-4914-9e7d-27d35e42c74b None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.496168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 114/219] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:32.502150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032b90c-7961-4a87-b35e-5b2339cdc685 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.502415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032b90c-7961-4a87-b35e-5b2339cdc685 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.502706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032b90c-7961-4a87-b35e-5b2339cdc685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.548401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c032b90c-7961-4a87-b35e-5b2339cdc685 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:32.549836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c032b90c-7961-4a87-b35e-5b2339cdc685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:32.567742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7822c-ff00-43da-b2bd-894248cf33c7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.609159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176385e2-acd2-4025-8d0c-30e42dfd9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.610281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176385e2-acd2-4025-8d0c-30e42dfd9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.611279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176385e2-acd2-4025-8d0c-30e42dfd9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.611752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176385e2-acd2-4025-8d0c-30e42dfd9bb4 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.614516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176385e2-acd2-4025-8d0c-30e42dfd9bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.616019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176385e2-acd2-4025-8d0c-30e42dfd9bb4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:32.618018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 106/220] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:32 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:32.619579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9cbf-2e6d-41a2-b7e7-e3dfd13d46d3 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.620064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9cbf-2e6d-41a2-b7e7-e3dfd13d46d3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.620508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9cbf-2e6d-41a2-b7e7-e3dfd13d46d3 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.621956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 107/221] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:32.626902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9cbf-2e6d-41a2-b7e7-e3dfd13d46d3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:32.663766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 115/222] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:32.665361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.665765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.666154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.685425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:32.687003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:32.703101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:32.752412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:32.813956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 116/223] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:32.816823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9cbf-2e6d-41a2-b7e7-e3dfd13d46d3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.875581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.876448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.876861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.877263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.878142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=eb559727f57f499b96c7bc4692cd8826) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:32.878636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.880357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:32.891316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 108/224] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:32 2022] GET /identity/v3/role_assignments?user.id=eb559727f57f499b96c7bc4692cd8826&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:33.015003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.133459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.169703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe961fe-5d8b-4d9c-967f-d29157cf119b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.250404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5251e9-ae3d-4dc3-842b-906e72caa831 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.263967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.264622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.265062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.265479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.287216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.288239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.288711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.289173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.289779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:33.291599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:33.294751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:33.295659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:33.301376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:33.302759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 117/225] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:33.303732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.318944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:33.319641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:33.327805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:33.328729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:33.329532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 109/226] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:33.336934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.417287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c076-9ecb-45bc-b986-ebe2f17a63de None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.457138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.458195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.458610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.459199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.460936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:33.461527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.464021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.476107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 118/227] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:33.486637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.524237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbca6e-5155-4edf-959b-b4764c9c9c8e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.563066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.582180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.582894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.583209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.583439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.584116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:33.584415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.585829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.600437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b422-994c-4325-9926-eaab887decb6 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.603600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 110/228] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:33.608991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.636248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.637328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.637776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.638243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] PATH_INFO: `/v3/users/d7f28dc4e3cc451c9aaadcfaba594685` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.639569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] RBAC: Authorizing `identity:get_user(user_id=d7f28dc4e3cc451c9aaadcfaba594685)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.641334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.643202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 119/229] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/users/d7f28dc4e3cc451c9aaadcfaba594685 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:33.649807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.751464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.769277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce40d-c275-4724-81c4-802f307ccb18 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.808332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.809251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.809527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.809796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.810998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.812451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.814457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 120/230] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:33.820479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.839049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.849460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd75b80-2bf6-4a85-ab0c-c40691d50d1a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.894565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.895240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.895551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.895820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] PATH_INFO: `/v3/users/d7f28dc4e3cc451c9aaadcfaba594685` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.897019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] RBAC: Authorizing `identity:get_user(user_id=d7f28dc4e3cc451c9aaadcfaba594685)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.898548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.900527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 111/231] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/users/d7f28dc4e3cc451c9aaadcfaba594685 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:33.911028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:34.024720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a983-e0a7-49d6-a7b6-6b73fb63046d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:34.049320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:34.062232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:34.062986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.063260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.063527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.063735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9c4d-4b81-48b8-9afe-50811bc0986f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:34.069081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:34.070568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:34.073533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 112/232] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:34.079454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:34.159461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988dc48-437b-43a1-9ed6-9b7d141fd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:34.160538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dc48-437b-43a1-9ed6-9b7d141fd183 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.161083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dc48-437b-43a1-9ed6-9b7d141fd183 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.161555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dc48-437b-43a1-9ed6-9b7d141fd183 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/d7f28dc4e3cc451c9aaadcfaba594685/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.167451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988dc48-437b-43a1-9ed6-9b7d141fd183 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3226da393364c7098a6f7470d2e7c4b, user_id=d7f28dc4e3cc451c9aaadcfaba594685, role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:34.169184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988dc48-437b-43a1-9ed6-9b7d141fd183 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:34.188952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3a9d6-6526-46fc-abcc-64ea8fec917f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:34.193104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 121/233] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:33 2022] PUT /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/d7f28dc4e3cc451c9aaadcfaba594685/roles/559beb10e54749d1b4ce94120725233a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:34.231192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fab50b-3b16-4529-8bd2-aa691c404990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:34.231996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab50b-3b16-4529-8bd2-aa691c404990 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.232274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab50b-3b16-4529-8bd2-aa691c404990 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.232541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fab50b-3b16-4529-8bd2-aa691c404990 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/d7f28dc4e3cc451c9aaadcfaba594685/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.234606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab50b-3b16-4529-8bd2-aa691c404990 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3226da393364c7098a6f7470d2e7c4b, user_id=d7f28dc4e3cc451c9aaadcfaba594685, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:34.236253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fab50b-3b16-4529-8bd2-aa691c404990 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:34.260265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 113/234] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:34 2022] PUT /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/d7f28dc4e3cc451c9aaadcfaba594685/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:34.527498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2956ab-b7ca-48f4-bc72-29e8c3a30540 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.528555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2956ab-b7ca-48f4-bc72-29e8c3a30540 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.529039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2956ab-b7ca-48f4-bc72-29e8c3a30540 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.530650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 122/235] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:34.536253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.536721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.536795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.556490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:34.557729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:34.602779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01877-f7cb-48b2-8136-37a37a81d659 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.603401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01877-f7cb-48b2-8136-37a37a81d659 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.603871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01877-f7cb-48b2-8136-37a37a81d659 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.605440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 123/236] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:34.608537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:34.611014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.611328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.611598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.632607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:34.634536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:34.639231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 114/237] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:34.697689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:34.712129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 124/238] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:34.994303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.023505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.124616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f433e-e875-44c9-826e-410890f3bc2b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:35.170095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:35.170885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.171164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.171542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.186572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145ae12-b93a-4794-8d61-5bcd055a6fb1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:35.192923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:35.203854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:35.204949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:35.205851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:35.214792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 115/239] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:35.222732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.252714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:35.253288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.253568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.253836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.256130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:35.257599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:35.259463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 125/240] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:35.266123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.292725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:35.345334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:35.359549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daaf8-ff0d-4d39-aab8-c598b717c5ab None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:35.390202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a4d5c-a138-4d96-98f9-78dacfd9f637 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:35.409800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:35.410862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.411999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.412480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.413720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:35.414236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:35.416368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddf4b7-c544-48cf-9dfe-4ca6788ec97c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:35.428931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 116/241] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:35.431239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdfc-7f9a-480e-b3b0-1553553cdaef None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.431730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdfc-7f9a-480e-b3b0-1553553cdaef None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.432446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdfc-7f9a-480e-b3b0-1553553cdaef None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.434914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 117/242] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:35.436064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1fdfc-7f9a-480e-b3b0-1553553cdaef None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.444975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b7e5b-98c4-4254-a512-1a3660f588d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:35.445611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7e5b-98c4-4254-a512-1a3660f588d6 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.445887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7e5b-98c4-4254-a512-1a3660f588d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.446165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7e5b-98c4-4254-a512-1a3660f588d6 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.446871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b7e5b-98c4-4254-a512-1a3660f588d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:35.448336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b7e5b-98c4-4254-a512-1a3660f588d6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:35.474045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 126/243] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:35 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:35.478873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.478873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.478873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.497421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:35.498721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:35.590808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 127/244] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:35.623865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1fdfc-7f9a-480e-b3b0-1553553cdaef None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:35.627254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:35.663416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:35.664165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.664447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.664720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] PATH_INFO: `/v3/users/b0676c9c32bd424e8ff95142c6011abf` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.679988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] RBAC: Authorizing `identity:get_user(user_id=b0676c9c32bd424e8ff95142c6011abf)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:35.681493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:35.683611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 118/245] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:35 2022] GET /identity/v3/users/b0676c9c32bd424e8ff95142c6011abf => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:35.689391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.771090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:35.823994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99496d68-091a-438e-8bad-979c41a2e409 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:35.859923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:35.861402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:35.861916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:35.862441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:35.921170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:35.934438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:35.937182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:35.988895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:36.038756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db8f8-5cfc-4515-af97-24a95befc219 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.051234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 128/246] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:36.055550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:36.105895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.107153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.108455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.108918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.122806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:36.128726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:36.129829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:36.130620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:36.136688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 119/247] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:36.139924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:36.172677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:36.198987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771e03-2191-464f-b254-ccc03448d86d None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.241396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.242263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.242615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.244998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.246396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:36.248101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:36.249931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 129/248] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:36 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:36.256072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:36.264772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd645-88f5-4c1f-a3b0-8acdabd3eafa None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.280463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:36.332740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.333735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.334081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.334426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.335282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:36.335671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:36.337141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:36.351614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 120/249] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:36.357632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:36.413173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a2bd0-e6b3-4fad-8e61-1f50aa196066 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.457364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.458123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.458401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.458667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.459441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] RBAC: Adding query filter params (role.id=ed7acc5f358e4c8fac6cc2abe37ee56d, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=b0676c9c32bd424e8ff95142c6011abf) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:36.459749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:36.461634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828bb8-0289-43d3-9abb-09f5d759c8a0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:36.468724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:36.468865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 130/250] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:36 2022] GET /identity/v3/role_assignments?user.id=b0676c9c32bd424e8ff95142c6011abf&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=ed7acc5f358e4c8fac6cc2abe37ee56d => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:36.492107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fa0ca-f2c6-4f15-9400-022c5ce72c3d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.535872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.536954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.537432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.537897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] PATH_INFO: `/v3/users/eb559727f57f499b96c7bc4692cd8826` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.539507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] RBAC: Authorizing `identity:get_user(user_id=eb559727f57f499b96c7bc4692cd8826)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:36.541335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:36.543723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 121/251] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:36 2022] GET /identity/v3/users/eb559727f57f499b96c7bc4692cd8826 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:36.548540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d8334-d00e-4aab-abbe-3aa4f04fa3dd None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.548813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d8334-d00e-4aab-abbe-3aa4f04fa3dd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.549077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d8334-d00e-4aab-abbe-3aa4f04fa3dd None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.550578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 131/252] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:36.553101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:36.558634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.558951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.559225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.593079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:36.594283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:36.708533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd432-7cd8-468d-8f60-da10c29743a1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.724583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 132/253] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:36.768328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498e47-34f0-4179-b622-4a1f489f7109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.768986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498e47-34f0-4179-b622-4a1f489f7109 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.769262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498e47-34f0-4179-b622-4a1f489f7109 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.769529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498e47-34f0-4179-b622-4a1f489f7109 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.770745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498e47-34f0-4179-b622-4a1f489f7109 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:36.772231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498e47-34f0-4179-b622-4a1f489f7109 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:36.774215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 122/254] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:36 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:36.780103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:36.800350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:36.933776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c4ad1-d397-463a-baef-d76282e97595 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:36.937459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3258-7fec-4bff-9f89-8edf4b528b49 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.937742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3258-7fec-4bff-9f89-8edf4b528b49 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.938109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3258-7fec-4bff-9f89-8edf4b528b49 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.941329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 123/255] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:36.948475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.949156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.949634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.970427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:36.972356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:36.987435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:36.988124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:36.988399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:36.988670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/eb559727f57f499b96c7bc4692cd8826/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:36.994567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] RBAC: Authorizing `identity:create_grant(project_id=c3226da393364c7098a6f7470d2e7c4b, user_id=eb559727f57f499b96c7bc4692cd8826, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:36.994567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:37.005951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:37.021996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 133/256] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:36 2022] PUT /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/eb559727f57f499b96c7bc4692cd8826/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:37.043856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.113030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 124/257] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:37.182269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:37.221687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28ca01-d1ba-4d4d-b606-35c701e5932a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:37.257815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:37.258548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:37.258864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:37.259133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:37.269808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:37.275016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:37.275894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:37.276827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 134/258] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:37.282243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.416248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2f487-cfb5-4dd8-9203-96b00d8c868d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:37.460453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:37.461215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:37.461676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:37.462020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:37.462806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:37.463258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:37.465101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:37.479697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 125/259] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:37.485665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.548608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.565026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:37.676699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017d40-590a-4f68-8b75-f3a54c739d9c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:37.710285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdc07-464d-4626-b7d1-9d11d61d45e6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:37.732789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:37.744519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:37.745275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:37.745555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:37.745827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] PATH_INFO: `/v3/users/d7f28dc4e3cc451c9aaadcfaba594685` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:37.749093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] RBAC: Authorizing `identity:get_user(user_id=d7f28dc4e3cc451c9aaadcfaba594685)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:37.750720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:37.751924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:37.752639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 135/260] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/users/d7f28dc4e3cc451c9aaadcfaba594685 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:37.753277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:37.753748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:37.754237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:37.758659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.767302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:37.773027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:37.774027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:37.775256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:37.777693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 126/261] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:37.783659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.857520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:37.890581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0266f2-ea0b-4b0d-ab72-b835132aa4b7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:37.905120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d443dc3-96be-4b7b-b091-ec6efdcfcab3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:37.926310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:37.927122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:37.927468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:37.927807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:37.928556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:37.928928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:37.930883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:37.939532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 127/262] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:37.945218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:37.946571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:37.947464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:37.947911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:37.948399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.021478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:38.027108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.028959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.050677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52973c8-adf0-463a-8969-f7b60204376f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:38.090429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:38.091210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:38.091558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:38.091901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] PATH_INFO: `/v3/users/d7f28dc4e3cc451c9aaadcfaba594685` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.093304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] RBAC: Authorizing `identity:get_user(user_id=d7f28dc4e3cc451c9aaadcfaba594685)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.094807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.096804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 128/263] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/users/d7f28dc4e3cc451c9aaadcfaba594685 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:38.102975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:38.105854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:38.155139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 136/264] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:38.161308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:38.210604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010c60-1032-4bc2-a7c9-e6cb93e2b833 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:38.247090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:38.247827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:38.248166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:38.248503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.271323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:38.276638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388477e1-7f2b-4a81-abf6-e66e8cbdac65 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:38.315547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:38.316566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:38.317036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:38.317701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.319209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.320892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.321100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.322537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.323542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 137/265] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:38 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:38.329548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:38.331064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:38.430534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 129/266] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 11:34:38.436510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:38.441085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31613-ac77-46a6-8e8d-640a7192d5bd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:38.479270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:38.480309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:38.480945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:38.481435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.482387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=d7f28dc4e3cc451c9aaadcfaba594685) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:38.482937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.484960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.492833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 138/267] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:38 2022] GET /identity/v3/role_assignments?user.id=d7f28dc4e3cc451c9aaadcfaba594685&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:38.608190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d613aa-5ada-4bac-9297-9fff7f6a5827 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:38.609830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:38.664310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fb54-f947-458a-b8df-bd0af514ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:38.664962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fb54-f947-458a-b8df-bd0af514ef35 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:38.665236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fb54-f947-458a-b8df-bd0af514ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:38.665500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fb54-f947-458a-b8df-bd0af514ef35 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.666757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144fb54-f947-458a-b8df-bd0af514ef35 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.668165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144fb54-f947-458a-b8df-bd0af514ef35 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.670171 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 130/268] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:38 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:38.676268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:38.715506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:38.788470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db343117-e268-419b-9c88-05d3273daac6 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:38.824058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:38.824682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:38.824959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:38.825226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:38.825965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] RBAC: Adding query filter params (role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=d7f28dc4e3cc451c9aaadcfaba594685) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:38.826273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:38.827772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a111-15a5-4bc8-af0e-86d68fd77418 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:38.834650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 139/269] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:38 2022] GET /identity/v3/role_assignments?user.id=d7f28dc4e3cc451c9aaadcfaba594685&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=559beb10e54749d1b4ce94120725233a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:39.201503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d0fe2-99c7-4ddb-8b81-7923358d11b2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.202538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d0fe2-99c7-4ddb-8b81-7923358d11b2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.203081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d0fe2-99c7-4ddb-8b81-7923358d11b2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.205018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 131/270] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:39.210431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cce2-59f7-4963-a64e-fce947b940bd None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.210732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cce2-59f7-4963-a64e-fce947b940bd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.211006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cce2-59f7-4963-a64e-fce947b940bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.233116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1c15cce2-59f7-4963-a64e-fce947b940bd None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:39.234320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1c15cce2-59f7-4963-a64e-fce947b940bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:39.314519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 140/271] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:39.362988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dac60-0121-4a68-b5a8-f1c131b50118 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.363302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dac60-0121-4a68-b5a8-f1c131b50118 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.363539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dac60-0121-4a68-b5a8-f1c131b50118 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.365190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 132/272] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:39.370796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e0c7-4c7d-48f7-834b-97b6f8077ecf None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.371085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e0c7-4c7d-48f7-834b-97b6f8077ecf None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.371358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e0c7-4c7d-48f7-834b-97b6f8077ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.391725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c237e0c7-4c7d-48f7-834b-97b6f8077ecf None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:39.393070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c237e0c7-4c7d-48f7-834b-97b6f8077ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:39.412429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:39.474756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 141/273] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:39.596419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dac60-0121-4a68-b5a8-f1c131b50118 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:39.673319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6f1b-7ee0-4dd6-868a-e9466fc1cb42 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.673648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6f1b-7ee0-4dd6-868a-e9466fc1cb42 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.673866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6f1b-7ee0-4dd6-868a-e9466fc1cb42 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.676499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 142/274] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:39.680568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.680898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.681387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.699875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:39.701162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:39.705888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dac60-0121-4a68-b5a8-f1c131b50118 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:39.752353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:39.752914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.753186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.753456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.764588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:39.769454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:39.770361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:39.771206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 133/275] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:39.776283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:39.793072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 143/276] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:39.795888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:39.812085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:39.890987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928da5d4-a724-4e54-ba6d-fcadfc965963 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:39.921969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:39.929130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be2638-1c0c-4bb9-8b24-791a96e758a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:39.929783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be2638-1c0c-4bb9-8b24-791a96e758a5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.930043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be2638-1c0c-4bb9-8b24-791a96e758a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.930311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be2638-1c0c-4bb9-8b24-791a96e758a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.931465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be2638-1c0c-4bb9-8b24-791a96e758a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:39.932949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be2638-1c0c-4bb9-8b24-791a96e758a5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:39.934703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 134/277] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:39.939955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331eca9-c883-46f0-89f6-aa518fa33ff7 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.940174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad041dd9-12cf-4f2b-8f6c-cd59ab4f4da0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:39.940320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331eca9-c883-46f0-89f6-aa518fa33ff7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.940505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331eca9-c883-46f0-89f6-aa518fa33ff7 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.942738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 135/278] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:39.943191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331eca9-c883-46f0-89f6-aa518fa33ff7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:39.979332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:39.979941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.980219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.980482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:39.981186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:39.981487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:39.982880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabfd98-b744-44a8-b2cd-6ff22fb4f038 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:39.996418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 144/279] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:39.996418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:39.996418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:39.996418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.014746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:40.015869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:40.048084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:40.054024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331eca9-c883-46f0-89f6-aa518fa33ff7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.087932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 145/280] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:40.088789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.100554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.101309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.101778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.102263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.103104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.105324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.134753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 136/281] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:34:39 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:40.134753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.178428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:40.210708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9a09-9d01-4b3d-af76-f85280d0cfb7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.244917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.245577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.245854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.246131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] PATH_INFO: `/v3/users/e59a65a6c3314e95a3fccdc57c2cb58a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.262066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] RBAC: Authorizing `identity:get_user(user_id=e59a65a6c3314e95a3fccdc57c2cb58a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.263705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.265600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 146/282] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/users/e59a65a6c3314e95a3fccdc57c2cb58a => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:40.268779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dca87-1dd7-429d-a2e8-7e5b61748e82 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.271839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.312227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.313615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.314287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.314968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.331460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:40.338606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:40.339579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:40.340362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 137/283] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:40.348986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.366111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:40.400484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522610f-0e51-4f57-9a77-e816f73cd257 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.441655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.442347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.442624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.442956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.443705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, user.id=e59a65a6c3314e95a3fccdc57c2cb58a, scope.system=all) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:40.444016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.445489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.447292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:40.452803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 147/284] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/role_assignments?user.id=e59a65a6c3314e95a3fccdc57c2cb58a&scope.system=all&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:40.453799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.467507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e291217-615f-4637-ab0e-bcc55d18f81d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.515141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.515797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.516096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.516404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.517163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:40.517535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.519099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.529239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 138/285] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:40.535636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.591983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc219ef-e3d2-489e-ae0a-aa119285e097 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.645608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.646273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.646548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.646940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.656009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:40.659916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:40.666548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:40.667616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:40.668807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 148/286] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:40.674517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.690152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4d97e-3b87-45e8-9098-fa77636831e4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.737685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.738344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.738627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.741547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] PATH_INFO: `/v3/users/b0676c9c32bd424e8ff95142c6011abf` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.741547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] RBAC: Authorizing `identity:get_user(user_id=b0676c9c32bd424e8ff95142c6011abf)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.741769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.743841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 139/287] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/users/b0676c9c32bd424e8ff95142c6011abf => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:40.750710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.776142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:40.884983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6624-8809-4739-8281-cf6db8d32a5b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.896146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3293b-c5f8-42f7-a1d2-ab169c70326f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:40.934662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.935508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.935793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.936066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.937383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.939179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.941373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 140/288] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:40.952461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:40.968424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:40.969048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:40.969328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:40.969600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:40.970275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:40.970954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:40.972377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:40.991063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:41.001000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 149/289] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:41.008709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:41.113935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0b18e-ca69-4788-9d75-abd0d56c1641 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:41.153810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:41.154757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:41.155040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:41.155315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/b0676c9c32bd424e8ff95142c6011abf/roles/ed7acc5f358e4c8fac6cc2abe37ee56d` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:41.157752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3226da393364c7098a6f7470d2e7c4b, user_id=b0676c9c32bd424e8ff95142c6011abf, role_id=ed7acc5f358e4c8fac6cc2abe37ee56d)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:41.159408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:41.176977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 141/290] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:34:40 2022] PUT /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b/users/b0676c9c32bd424e8ff95142c6011abf/roles/ed7acc5f358e4c8fac6cc2abe37ee56d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:41.244929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b720c62-2875-41df-a8af-556a0371f7fa None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:41.270628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:41.295622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:41.296301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:41.296576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:41.296928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] PATH_INFO: `/v3/users/eb559727f57f499b96c7bc4692cd8826` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:41.298301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=eb559727f57f499b96c7bc4692cd8826)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:41.299815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:41.301461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 150/291] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:41 2022] GET /identity/v3/users/eb559727f57f499b96c7bc4692cd8826 => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:41.307715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:41.420251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:41.454923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee50bf5-a5de-49f4-8a46-8c8e7cfb8823 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:41.489955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:41.490641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:41.491018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:41.491293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:41.574514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:41.576009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:41.663233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:41.703336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 142/292] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:41.709448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:41.873351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef843-8961-4ad5-92db-242f368ccbb3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:41.924757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67567f6d-63c5-4b6d-b47b-54d8e1a70e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:41.925453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67567f6d-63c5-4b6d-b47b-54d8e1a70e23 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:41.925685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67567f6d-63c5-4b6d-b47b-54d8e1a70e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:41.925936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67567f6d-63c5-4b6d-b47b-54d8e1a70e23 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:41.927291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67567f6d-63c5-4b6d-b47b-54d8e1a70e23 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:41.929721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67567f6d-63c5-4b6d-b47b-54d8e1a70e23 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:41.933234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 151/293] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:41 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:41.938869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:42.071934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e24d4-0169-41e4-a69b-7060452f62cf None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:42.119824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:42.120444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:42.120714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:42.120980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:42.121808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=eb559727f57f499b96c7bc4692cd8826) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:42.122116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:42.123649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8490-ce26-42e9-b446-08655a9b7bf7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:42.135679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 143/294] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:41 2022] GET /identity/v3/role_assignments?user.id=eb559727f57f499b96c7bc4692cd8826&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:42.515245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da50695-4d37-4775-a22f-45248cefa92b None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:42.515624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da50695-4d37-4775-a22f-45248cefa92b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:42.515800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da50695-4d37-4775-a22f-45248cefa92b None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:42.517453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 152/295] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:42.522790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55c7f-6e37-42be-a429-81fb0479ca75 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:42.523280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55c7f-6e37-42be-a429-81fb0479ca75 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:42.523356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55c7f-6e37-42be-a429-81fb0479ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:42.545651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e9d55c7f-6e37-42be-a429-81fb0479ca75 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:42.547224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e9d55c7f-6e37-42be-a429-81fb0479ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:42.580174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:42.622908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 144/296] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:42.718381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a81b-a715-4736-b2ad-2d6c992305b2 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:42.718651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a81b-a715-4736-b2ad-2d6c992305b2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:42.718994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a81b-a715-4736-b2ad-2d6c992305b2 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:42.720939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 153/297] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:42.727443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff32de-b746-4fe2-af55-94f68eb709e9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:42.727788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff32de-b746-4fe2-af55-94f68eb709e9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:42.728147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff32de-b746-4fe2-af55-94f68eb709e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:42.750106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3eff32de-b746-4fe2-af55-94f68eb709e9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:42.751328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3eff32de-b746-4fe2-af55-94f68eb709e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:42.835454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 145/298] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:42.918663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a81b-a715-4736-b2ad-2d6c992305b2 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:42.986768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.007242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4c9d7-4160-4326-89d9-db2b420a2a0c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.007582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4c9d7-4160-4326-89d9-db2b420a2a0c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.007838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4c9d7-4160-4326-89d9-db2b420a2a0c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.009583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 146/299] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:43.015526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.016131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.016602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.037678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:43.037988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a81b-a715-4736-b2ad-2d6c992305b2 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.039650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:43.075715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.076368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.076640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.076904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.090001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:43.096091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:43.098065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:43.100249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 154/300] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:43.103801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.154342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 147/301] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:43.162911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.184373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.238711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e5cb1-1bc6-46bc-9e8b-cb426d6b2a79 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.256234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.275519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30745a6a-5210-4347-9cdc-a7e447c70205 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.275733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.276137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.276413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.276684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.277351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:43.277651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.279115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.288599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 155/302] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:43.293912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.322273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.323092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.323369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.323940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.325281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.327201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.329085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 148/303] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:43.334928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.408275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162a12b-072a-4ea3-8c61-ca306eafb519 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.445765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.446403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.446708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.447373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] PATH_INFO: `/v3/users/603940545ec848de9d0d2205e455ed33` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.450761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.459364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d1aae-001f-43bb-aa45-6a30aec1f704 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.461493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] RBAC: Authorizing `identity:get_user(user_id=603940545ec848de9d0d2205e455ed33)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.463039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.471719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 156/304] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/users/603940545ec848de9d0d2205e455ed33 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:43.471719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.507578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.508200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.508478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.508746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] PATH_INFO: `/v3/groups` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.509386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.510381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.510865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.528047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 149/305] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Sep 6 11:34:43 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:43.540574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.597650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07f8b1-7934-4e0b-b2a4-53d8ea93afc3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.639370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849b8c3-c0b6-4fa8-97f1-eb826872fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.640173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b8c3-c0b6-4fa8-97f1-eb826872fbdb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.640308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b8c3-c0b6-4fa8-97f1-eb826872fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.640570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b8c3-c0b6-4fa8-97f1-eb826872fbdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.654735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849b8c3-c0b6-4fa8-97f1-eb826872fbdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-c849b8c3-c0b6-4fa8-97f1-eb826872fbdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:43.660332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:43.661480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:43.662421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:43.664688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 157/306] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:43.666719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2a60-65d8-4111-912f-530b94d5f0d0 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.667005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2a60-65d8-4111-912f-530b94d5f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.667277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2a60-65d8-4111-912f-530b94d5f0d0 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.668856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 158/307] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:43.673968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2a60-65d8-4111-912f-530b94d5f0d0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.678598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2501-d6bd-4a49-9b71-b0feaf2d3bfa None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.723675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.724313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.724589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.725433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.726228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] RBAC: Adding query filter params (role.id=ed7acc5f358e4c8fac6cc2abe37ee56d, user.id=603940545ec848de9d0d2205e455ed33, scope.system=all) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:43.726534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.728076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbbd6e-6304-4138-bf04-562db7eb1390 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.735566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 150/308] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/role_assignments?user.id=603940545ec848de9d0d2205e455ed33&scope.system=all&role.id=ed7acc5f358e4c8fac6cc2abe37ee56d => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:43.736641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.736920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.737185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.759880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:43.761208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:43.781700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.816887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.825336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2a60-65d8-4111-912f-530b94d5f0d0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.864789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 151/309] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:43.878985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.879714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.880012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.880277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.881009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:43.881306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.882916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.894425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 159/310] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:43.900683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.023730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a298865-a34b-4714-8f50-7f47ead08f8c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.064621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.065733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.066211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.066737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] PATH_INFO: `/v3/users/e59a65a6c3314e95a3fccdc57c2cb58a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.068271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] RBAC: Authorizing `identity:get_user(user_id=e59a65a6c3314e95a3fccdc57c2cb58a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.069964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.072223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 152/311] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/users/e59a65a6c3314e95a3fccdc57c2cb58a => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:44.078748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.173010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.185517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1c2c2-7fe1-4560-8da0-64c769e6ebcb None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.220385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.221578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.221854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.222121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] PATH_INFO: `/v3/system/users/e59a65a6c3314e95a3fccdc57c2cb58a/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.223717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e59a65a6c3314e95a3fccdc57c2cb58a, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.224795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:44.225155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.240007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 160/312] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Sep 6 11:34:44 2022] PUT /identity/v3/system/users/e59a65a6c3314e95a3fccdc57c2cb58a/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:44.304477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094936ca-d03f-4ea4-a440-c9ed2446c46a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.345018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.346432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.346943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.347413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.360231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:44.365775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:44.366732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:44.367535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:44.370343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 153/313] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:44.376597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.403710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:44.483250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6b47-613f-4c8d-b9a8-17c9cdd094a6 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.517961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.518579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.518888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.519226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.519906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:44.520329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.521733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.531286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 161/314] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:44.537461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.620668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:44.647230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786242-6e88-4ab6-b55d-eb946b6c25b3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.687015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.687716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.687996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.688266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] PATH_INFO: `/v3/users/b0676c9c32bd424e8ff95142c6011abf` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.689423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] RBAC: Authorizing `identity:get_user(user_id=b0676c9c32bd424e8ff95142c6011abf)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.690907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.692923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 154/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:44 2022] GET /identity/v3/users/b0676c9c32bd424e8ff95142c6011abf => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:44.698481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.814231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:44.831514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030609c-5902-4027-b8b1-06bc631bd069 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.867480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.868108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.868387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.868655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.944354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.945842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.043184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:45.046590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 162/316] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:45.052849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.155600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dd71b-c55b-46fe-b6ca-ca618fe99493 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.190276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034b6c-de30-40d7-9f74-d385507e67c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.190956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034b6c-de30-40d7-9f74-d385507e67c8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.191237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034b6c-de30-40d7-9f74-d385507e67c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.191508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034b6c-de30-40d7-9f74-d385507e67c8 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.192698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034b6c-de30-40d7-9f74-d385507e67c8 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.194161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034b6c-de30-40d7-9f74-d385507e67c8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.196218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 155/317] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:45 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:45.202138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.311098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6591-ff4f-43c0-89b8-607dfb1fc758 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.346703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.347343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.347621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.347893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.348702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] RBAC: Adding query filter params (role.id=ed7acc5f358e4c8fac6cc2abe37ee56d, scope.project.id=c3226da393364c7098a6f7470d2e7c4b, user.id=b0676c9c32bd424e8ff95142c6011abf) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:45.349014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.350533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1ccdf-63c1-4b55-9290-cea1eb78eaa0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.357950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 163/318] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:34:45 2022] GET /identity/v3/role_assignments?user.id=b0676c9c32bd424e8ff95142c6011abf&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=ed7acc5f358e4c8fac6cc2abe37ee56d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:45.564942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccbbe9-90ef-40f4-918f-9578b22b98cb None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.565446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccbbe9-90ef-40f4-918f-9578b22b98cb None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.565446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccbbe9-90ef-40f4-918f-9578b22b98cb None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.566913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 156/319] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:45.572172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd4c0-378e-4bab-a181-4adb05e7ab4c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.572439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd4c0-378e-4bab-a181-4adb05e7ab4c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.572707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd4c0-378e-4bab-a181-4adb05e7ab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.594416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-248cd4c0-378e-4bab-a181-4adb05e7ab4c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:45.596267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-248cd4c0-378e-4bab-a181-4adb05e7ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.643279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:45.668057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 164/320] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:45.766746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31282438-2115-4bbc-9c75-6897eeee76a2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.767089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31282438-2115-4bbc-9c75-6897eeee76a2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.767307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31282438-2115-4bbc-9c75-6897eeee76a2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.768790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 157/321] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:45.774139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.774544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.774865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.793621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:45.794855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.873274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 165/322] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:45.935921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31282438-2115-4bbc-9c75-6897eeee76a2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.951961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.045338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31282438-2115-4bbc-9c75-6897eeee76a2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.083462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.084331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.084755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.085123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.086440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.087916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.089539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 158/323] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:46.096168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.149965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.210299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef46f-3aa8-444a-a839-d876a03d6e9e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.221031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.240277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.248701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc06a2-0c87-4945-a07d-c1b6cf2c775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.249212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc06a2-0c87-4945-a07d-c1b6cf2c775e None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.255004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc06a2-0c87-4945-a07d-c1b6cf2c775e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.255004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc06a2-0c87-4945-a07d-c1b6cf2c775e None admin] PATH_INFO: `/v3/groups` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.255004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc06a2-0c87-4945-a07d-c1b6cf2c775e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.255004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc06a2-0c87-4945-a07d-c1b6cf2c775e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.261852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7fd7a-b5c3-47e5-aedd-ace03859a10d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.270522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 166/324] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:46.282892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08a97-911c-44d7-bb0a-3cac24b856f5 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.282892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08a97-911c-44d7-bb0a-3cac24b856f5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.282892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08a97-911c-44d7-bb0a-3cac24b856f5 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.282892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 167/325] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:46.282892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.282892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.283396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.299720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:46.301029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:46.306583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.307401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.307744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.308076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.320892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:46.326545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:46.327675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:46.328721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 159/326] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:46.334039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.388308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 168/327] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:46.454166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e923f-e07f-4b98-aa31-dcd527e8876f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.489351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.489940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.490219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.490489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.491192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:46.491550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.492968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.504405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 160/328] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:46.511314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.624491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.629067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e53bed-6309-4c33-88b1-96e150881753 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.655064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.658032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.675481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.676596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.676875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.677146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] PATH_INFO: `/v3/users/603940545ec848de9d0d2205e455ed33` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.678315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] RBAC: Authorizing `identity:get_user(user_id=603940545ec848de9d0d2205e455ed33)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.680110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.681638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 169/329] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/users/603940545ec848de9d0d2205e455ed33 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:46.687158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.809315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228504-5ff2-46b3-a610-0d411ca4b404 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.818841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35965a28-e8da-45be-9b1d-929a2b230368 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.861314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.862322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.862781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.866791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.869835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.871913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.872571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.873505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] PATH_INFO: `/v3/system/users/603940545ec848de9d0d2205e455ed33/roles/ed7acc5f358e4c8fac6cc2abe37ee56d` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.876232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=603940545ec848de9d0d2205e455ed33, role_id=ed7acc5f358e4c8fac6cc2abe37ee56d)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.878293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.881778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:46.888319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 170/330] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Sep 6 11:34:46 2022] PUT /identity/v3/system/users/603940545ec848de9d0d2205e455ed33/roles/ed7acc5f358e4c8fac6cc2abe37ee56d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:46.888759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:46.889732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:46.890638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:46.891308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 161/331] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:46.897585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.932781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:47.013757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884cf3-094a-4d27-8190-2de49925a621 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.051618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.052262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.052641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.052765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.053444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:47.053741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.055190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.065286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 171/332] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:47.071104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.147986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:47.190847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b1d5-a406-4632-84d3-15daab4e10dc None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.232358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e76602-f141-4e93-99c6-c3ed940cb2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.233007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e76602-f141-4e93-99c6-c3ed940cb2c4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.233283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e76602-f141-4e93-99c6-c3ed940cb2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.233551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e76602-f141-4e93-99c6-c3ed940cb2c4 None admin] PATH_INFO: `/v3/users/e59a65a6c3314e95a3fccdc57c2cb58a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.234798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e76602-f141-4e93-99c6-c3ed940cb2c4 None admin] RBAC: Authorizing `identity:get_user(user_id=e59a65a6c3314e95a3fccdc57c2cb58a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.236284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e76602-f141-4e93-99c6-c3ed940cb2c4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.238235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 162/333] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:47 2022] GET /identity/v3/users/e59a65a6c3314e95a3fccdc57c2cb58a => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:47.244133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.366904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:47.380077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279928e-7bf4-4027-9be6-eedea3a282fc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.426414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.427121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.427443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.427712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.428454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] RBAC: Adding query filter params (role.id=7a9fe76f438347f8a55ca531d152d5c2, user.id=e59a65a6c3314e95a3fccdc57c2cb58a, scope.system=all) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:47.428760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.430217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d576c-5932-48e4-9195-15d70559fc14 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.443518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 172/334] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 6 11:34:47 2022] GET /identity/v3/role_assignments?user.id=e59a65a6c3314e95a3fccdc57c2cb58a&scope.system=all&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:48.961638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873781e-bb91-4ab3-8151-51646190b621 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.962180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873781e-bb91-4ab3-8151-51646190b621 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.962180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873781e-bb91-4ab3-8151-51646190b621 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.963551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 163/335] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:48.969651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6acd-ca96-4862-bb7a-4f62c42fbf4b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.970142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6acd-ca96-4862-bb7a-4f62c42fbf4b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.970142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6acd-ca96-4862-bb7a-4f62c42fbf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.991423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f1df6acd-ca96-4862-bb7a-4f62c42fbf4b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:48.992654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f1df6acd-ca96-4862-bb7a-4f62c42fbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:49.001756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a09f4-d47a-4572-b16d-c848937d9fc1 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.002046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a09f4-d47a-4572-b16d-c848937d9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.002296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a09f4-d47a-4572-b16d-c848937d9fc1 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.004561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 164/336] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:49.010056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbf04a-fcf2-40c8-acb2-d8e5fc26f267 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.010502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbf04a-fcf2-40c8-acb2-d8e5fc26f267 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.010827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbf04a-fcf2-40c8-acb2-d8e5fc26f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.049248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-4cdbf04a-fcf2-40c8-acb2-d8e5fc26f267 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:49.050486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4cdbf04a-fcf2-40c8-acb2-d8e5fc26f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:49.120140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 173/337] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:49.174711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 165/338] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:49.386180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157a165-eaf2-4080-b4f1-2d7e333a896c None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.386535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157a165-eaf2-4080-b4f1-2d7e333a896c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.386635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157a165-eaf2-4080-b4f1-2d7e333a896c None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.388120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 174/339] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:49.393975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.394269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.394533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.420165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:49.421389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:49.425118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157a165-eaf2-4080-b4f1-2d7e333a896c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:49.507364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:49.537525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 166/340] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:49.592970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:49.627424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157a165-eaf2-4080-b4f1-2d7e333a896c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:49.671367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:49.672388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.672863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.673329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.676392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:49.692966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:49.698417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:49.699338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:49.700125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:49.706782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 175/341] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:49.708810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:49.869897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a4d4-f9d7-4015-9173-80d30dd1f015 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:49.927443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e9dba-50b4-43a9-a72f-b85b967b3774 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:49.933529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373163a1-a055-4398-9b23-5dd69ec0d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:49.934500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373163a1-a055-4398-9b23-5dd69ec0d18d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.934950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373163a1-a055-4398-9b23-5dd69ec0d18d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.935378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373163a1-a055-4398-9b23-5dd69ec0d18d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.951738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373163a1-a055-4398-9b23-5dd69ec0d18d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-373163a1-a055-4398-9b23-5dd69ec0d18d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:49.956876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:49.958116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:49.958987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:49.961305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 167/342] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:49.962676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1a99-b814-4441-9387-4cdb70c3be15 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.967868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1a99-b814-4441-9387-4cdb70c3be15 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.968266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1a99-b814-4441-9387-4cdb70c3be15 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.970302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 168/343] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:49.972012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:49.972740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.973162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.973383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b1a99-b814-4441-9387-4cdb70c3be15 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:49.973633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.974478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:49.974941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:49.976437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58503f-83ba-4c5b-bd19-a4f16fa035b4 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:49.992618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 176/344] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:49.992618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.992618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.992966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.006200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.012085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:50.013512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:50.048938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.093268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 177/345] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:50.094095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.139071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b1a99-b814-4441-9387-4cdb70c3be15 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:50.176272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:50.177263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:50.177798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:50.178273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.179259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:50.179784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:50.181471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:50.198374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 169/346] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:50.199725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.224578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87e89a-cfcd-4af1-b127-d4d06f0110f7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:50.257269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.264540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:50.265157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:50.265430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:50.265696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.328592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8b8e-d3e4-41de-9630-c5faf1ed7dff None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:50.340414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:50.342076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:50.344284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.383255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:50.384118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:50.384508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:50.384916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.403215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:50.409552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:50.410701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 11:34:50.411552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:50.414064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 170/347] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:50.415228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.476106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 178/348] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:50.476970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.536141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.569032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aedcfe-1ba9-4b47-b33f-79efd924ad19 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:50.617996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:50.618652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:50.619032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:50.619308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.630951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74319e-20c9-408e-8932-7050a88c1458 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:50.674995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.679795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:50.681219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:50.681644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:50.682555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.683701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:50.684181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:50.686382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:50.698043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 179/349] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:50.699995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.709036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:50.712363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:50.830414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:50.838753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe463-e842-4049-b261-a4de92d8fa22 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:50.858829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 171/350] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:50.860126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.884931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:50.886041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:50.886390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:50.886758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:50.887977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:50.890126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:50.892741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 180/351] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:50.894088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:50.951068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.005660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddc94f-15f5-489d-a797-711392da0d0a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.040820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5867-5b84-4d15-85ae-a73e7a1ebb17 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.053945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.054758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.055102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.055338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.071187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:51.076903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:51.077828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:51.078608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:51.079363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 172/352] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:51.080088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.093918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.094506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.096044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.096044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] PATH_INFO: `/v3/users/603940545ec848de9d0d2205e455ed33` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.097636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=603940545ec848de9d0d2205e455ed33)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.101105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.101779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 181/353] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:34:50 2022] GET /identity/v3/users/603940545ec848de9d0d2205e455ed33 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.103034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.148240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.222450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a028d4-93ed-4fd1-9f14-439f2357b317 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.240209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8c3e-b680-4a61-90ad-8574903ab1b9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.265204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.273856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab5def-1d6f-4f40-8afa-e0a7194159b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.274510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5def-1d6f-4f40-8afa-e0a7194159b2 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.274814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5def-1d6f-4f40-8afa-e0a7194159b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.275089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5def-1d6f-4f40-8afa-e0a7194159b2 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.276936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab5def-1d6f-4f40-8afa-e0a7194159b2 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.278469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab5def-1d6f-4f40-8afa-e0a7194159b2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.279466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c34bb4-4150-421e-9ca3-68d4340662e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.280122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c34bb4-4150-421e-9ca3-68d4340662e1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.280396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c34bb4-4150-421e-9ca3-68d4340662e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.280670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c34bb4-4150-421e-9ca3-68d4340662e1 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.282768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 173/354] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.284439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a91e84-06d3-4db5-ac62-64f8496704e8 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.284709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a91e84-06d3-4db5-ac62-64f8496704e8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.284973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a91e84-06d3-4db5-ac62-64f8496704e8 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.286390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 174/355] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:51.287679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a91e84-06d3-4db5-ac62-64f8496704e8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.288278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c34bb4-4150-421e-9ca3-68d4340662e1 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.289770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c34bb4-4150-421e-9ca3-68d4340662e1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.291535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 182/356] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.292721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e863-7c77-476c-83a4-1d92fe71df78 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.292998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e863-7c77-476c-83a4-1d92fe71df78 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.293270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e863-7c77-476c-83a4-1d92fe71df78 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.295522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 183/357] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:51.295522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e863-7c77-476c-83a4-1d92fe71df78 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.421294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.431093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e863-7c77-476c-83a4-1d92fe71df78 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.433013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a91e84-06d3-4db5-ac62-64f8496704e8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.469372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.469990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.470268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.470925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.471660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] RBAC: Adding query filter params (role.id=ed7acc5f358e4c8fac6cc2abe37ee56d, user.id=603940545ec848de9d0d2205e455ed33, scope.system=all) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:51.471967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.473463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee82a4-a85c-4fc8-a126-627d7b4f0d72 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.473877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.474559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.474945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.475213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.476006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:51.476307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.477684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.487782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 175/358] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.488325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.497820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 184/359] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/role_assignments?user.id=603940545ec848de9d0d2205e455ed33&scope.system=all&role.id=ed7acc5f358e4c8fac6cc2abe37ee56d => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.497820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.497820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.497820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.518369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:51.520391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:51.570594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.622457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 185/360] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:51.627250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.629884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b494-e8f6-44d3-a25e-49547f498a15 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.685233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1dbc7-8b91-4fc5-8bcf-8252d6dd241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.686301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1dbc7-8b91-4fc5-8bcf-8252d6dd241d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.686581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1dbc7-8b91-4fc5-8bcf-8252d6dd241d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.686885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1dbc7-8b91-4fc5-8bcf-8252d6dd241d None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.688635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1dbc7-8b91-4fc5-8bcf-8252d6dd241d None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.690120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1dbc7-8b91-4fc5-8bcf-8252d6dd241d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.692141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 176/361] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.693160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.693441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.693714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.715418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:51.716715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:51.746817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.770460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558b4e4-9306-43ff-aa33-46db27441b3a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.804175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 177/362] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:51.805053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.811166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.811779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.812094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.812359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.813085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=f2f98a274c514a69adb9c210ec141387) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:51.813821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.815322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.822839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 186/363] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=559beb10e54749d1b4ce94120725233a => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:51.823729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.938868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:51.984865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048832-0824-4935-938e-b1ccb5ea79d1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.997055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c04b9-67c9-44f9-b365-55721b1003fd None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.032340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.032965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.033246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.033511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.034245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=f2f98a274c514a69adb9c210ec141387) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:52.034556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:52.036106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:52.046358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 187/364] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:52.048112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.054194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.054817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.055081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.055353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.071061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:52.144831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:52.146446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:52.193362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dc1fa-3ea1-47b9-8855-7d776e883e17 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.215497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:52.236391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.237508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.237985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.238450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.259086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:52.266186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:52.267417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:52.268226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:52.271719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 188/365] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:52.273011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.287056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 178/366] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:52.288020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.368555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:52.410873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d67d-eb3e-4676-b364-1377f961e2dd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.425551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f29e8-5033-444f-8609-39b71a15e3c8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.462419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.463664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.464353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.464787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.473363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.473915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.474192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.474461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.475231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:52.475595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:52.477058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:52.482274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:52.488425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 179/367] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:52.489218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:52.490103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:52.490950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:52.491551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.496674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 189/368] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:52.501010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.531075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:52.628566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba3c2-004a-4fdc-8df8-f7282466d241 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.633546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f291be-5128-4132-92ee-97bfc51e8b8e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.666894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.667608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.667886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.668155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.669336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:52.670898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:52.671839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:52.673005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 180/369] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:52.674156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.682990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.683693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.683971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.684243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.787346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:52.789065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:52.819061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:52.823410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475a58-cc33-4da9-a1dd-d3eafbe701cb None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:52.867697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:52.869271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:52.869635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:52.869984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:52.870783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:52.871166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:52.872735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:52.888280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 181/370] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:52.888280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.910741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 190/371] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:52.912036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:52.949092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:53.018473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d922f9-902f-4fb8-8f7d-ec565ce75b93 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.035910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471687c-4611-49b0-a99e-9bbf896731d1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.060341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.061002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.061278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.061546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.067516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.069020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.070709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 182/372] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.071487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.088978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.089673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.089993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.090291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.112931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:53.186696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.188190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.226490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:53.231404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a17bc0-ff5e-4789-90ee-0133cc1ead93 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.289182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.289754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.290025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.290291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.291462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.292903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.294936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 183/373] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.295848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.326896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 191/374] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:34:53.331632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.420153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:53.438626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8b761-5586-494c-a9cd-bd966e11ff2c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.470794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba873-911c-44c7-aec6-b4f82d548c7f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.485255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.486269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.486709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.487120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.488005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=c3226da393364c7098a6f7470d2e7c4b) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:53.488475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.491116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.498019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 184/375] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.499077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.502569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:53.513527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.514196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.514842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.514842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.515997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.517478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.519517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 192/376] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.527804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.621909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47a9c-ac06-4fcd-a08a-2d30cce7a045 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.669127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.670576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.670885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.671150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] PATH_INFO: `/v3/projects/b38d4dcd6a0e45e880f97fafaba71561` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.672501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d4dcd6a0e45e880f97fafaba71561)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.673980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.685890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 185/377] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/projects/b38d4dcd6a0e45e880f97fafaba71561 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.698164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.716196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942a148-031c-4fd6-bcca-abf71ea9a61e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.733580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:53.766140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.766140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.766140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.766140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.768365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=c3226da393364c7098a6f7470d2e7c4b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:53.768680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.770320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.780922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 193/378] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=559beb10e54749d1b4ce94120725233a => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.836001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcefcf2-4e2f-45b1-a186-26b4929c1468 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:53.880890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6adc0e-c7be-4a00-9592-94d5ffdf646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:53.881914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6adc0e-c7be-4a00-9592-94d5ffdf646a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:53.882410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6adc0e-c7be-4a00-9592-94d5ffdf646a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:53.882925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6adc0e-c7be-4a00-9592-94d5ffdf646a None admin] PATH_INFO: `/v3/groups/6b6f3325a61649009f5f84b8c1b8b5a2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:53.891442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6adc0e-c7be-4a00-9592-94d5ffdf646a None admin] RBAC: Authorizing `identity:get_group(group_id=6b6f3325a61649009f5f84b8c1b8b5a2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:53.892954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6adc0e-c7be-4a00-9592-94d5ffdf646a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:53.894825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 186/379] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/groups/6b6f3325a61649009f5f84b8c1b8b5a2 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:53.901486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:53.992712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:54.047271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb994d55-7646-463b-bf9e-5b0c1b2dc2dc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:54.093545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:54.094217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:54.094501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:54.094668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:54.095803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] RBAC: Adding query filter params (group.id=6b6f3325a61649009f5f84b8c1b8b5a2, role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=b38d4dcd6a0e45e880f97fafaba71561) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:54.096117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:54.097745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a71f4-e98f-43da-a92f-4cbfcff589a0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:54.108421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 194/380] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:34:53 2022] GET /identity/v3/role_assignments?group.id=6b6f3325a61649009f5f84b8c1b8b5a2&scope.project.id=b38d4dcd6a0e45e880f97fafaba71561&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:54.310713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f4754-8f55-45d2-89b5-13f3d82e7493 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:54.311257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f4754-8f55-45d2-89b5-13f3d82e7493 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:54.311571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f4754-8f55-45d2-89b5-13f3d82e7493 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:54.313070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 187/381] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:54.320442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:54.320756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:54.321055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:54.343708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:54.345324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:54.358091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390e65-abaf-4924-a4b0-35e16bb89430 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:54.358427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390e65-abaf-4924-a4b0-35e16bb89430 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:54.358651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390e65-abaf-4924-a4b0-35e16bb89430 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:54.360287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 188/382] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:54.365831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:54.366114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:54.366389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:54.401844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:54.403071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:54.456715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 195/383] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:54.510203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 189/384] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:54.872259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:54.916760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:54.943094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:54.949232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:55.007921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372561a7-fb5f-4f5a-a779-77ca18fc022b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.064977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.065635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.065907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.066173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.087316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:55.092290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:55.093173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:55.094451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 196/385] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:55.108300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.131643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75338640-8804-47d1-83f1-d57b99db2143 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.231434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.232099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.232382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.232656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.248435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f1fa-393d-4249-a3cd-e71c8bcaaca1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.256278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:55.265490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:55.266369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:55.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 190/386] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:34:55.272430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.275030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:55.301500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.302185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.302414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.302676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.303372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:55.303674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:55.305093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:55.323555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 197/387] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:55.331021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.443303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:55.495587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766a039-2320-455f-8d4a-d0fd371b08b1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.552981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.553840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.554316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.554758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.555110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dc81-2cf8-4180-8dfd-af4770f1976e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.555779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:55.556275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:55.557812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:55.576069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 191/388] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:55.581511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.598476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.599169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.599446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.599722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.600904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:55.602384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:55.606528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 198/389] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:55.610623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.682723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:55.738199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f426045-871c-4936-8373-46c251dd7743 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.782355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.783090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.783366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.783639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.784896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:55.786393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:55.788101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 199/390] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:55.795722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.800243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc52c6-2992-4c3f-9b65-083ca37a255a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.838896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.839459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.839734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.840003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.841359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:55.842953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:55.848469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 192/391] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:55.850903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.861681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:55.982046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877408-b6a9-41b0-aab9-a7a272dea253 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.994316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451394-b548-4083-ad50-14cb6866fe31 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:56.012017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:56.032347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:56.033073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.033355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.033731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387/groups/78df46fb1660421cae10e26903106d14/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.036264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f98a274c514a69adb9c210ec141387, group_id=78df46fb1660421cae10e26903106d14, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:56.037932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:56.051470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486918-9ead-407f-815b-c9b3d3902f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:56.054644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486918-9ead-407f-815b-c9b3d3902f99 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.055010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486918-9ead-407f-815b-c9b3d3902f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.055780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486918-9ead-407f-815b-c9b3d3902f99 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.058309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486918-9ead-407f-815b-c9b3d3902f99 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:56.060219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 200/392] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 6 11:34:55 2022] PUT /identity/v3/projects/f2f98a274c514a69adb9c210ec141387/groups/78df46fb1660421cae10e26903106d14/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:56.060901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486918-9ead-407f-815b-c9b3d3902f99 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:56.063074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 193/393] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:56.075591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:56.200322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900808-845a-4eea-a251-69cd34f186e3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:56.215427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4336c06-ac21-4f12-bb91-f735e22dc40f None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.215746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4336c06-ac21-4f12-bb91-f735e22dc40f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.215974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4336c06-ac21-4f12-bb91-f735e22dc40f None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.218228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 194/394] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:56.223939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5046-d28e-4c5d-84fe-d8a72831ded7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.224223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5046-d28e-4c5d-84fe-d8a72831ded7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.224499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5046-d28e-4c5d-84fe-d8a72831ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.248245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-828d5046-d28e-4c5d-84fe-d8a72831ded7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:56.249435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-828d5046-d28e-4c5d-84fe-d8a72831ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:56.254723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080485a-c611-4243-a177-7da501de058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:56.255690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080485a-c611-4243-a177-7da501de058e None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.256170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080485a-c611-4243-a177-7da501de058e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.256639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080485a-c611-4243-a177-7da501de058e None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387/groups/78df46fb1660421cae10e26903106d14/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.259883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080485a-c611-4243-a177-7da501de058e None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f98a274c514a69adb9c210ec141387, group_id=78df46fb1660421cae10e26903106d14, role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:56.262091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080485a-c611-4243-a177-7da501de058e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:56.284125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 201/395] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 6 11:34:56 2022] PUT /identity/v3/projects/f2f98a274c514a69adb9c210ec141387/groups/78df46fb1660421cae10e26903106d14/roles/559beb10e54749d1b4ce94120725233a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:56.318435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9edf4-2319-44aa-ac29-52d9372f6d9d None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.318825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9edf4-2319-44aa-ac29-52d9372f6d9d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.319067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9edf4-2319-44aa-ac29-52d9372f6d9d None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.321169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 202/396] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:56.330014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.330295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.330564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.351833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:56.353056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:56.385420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:56.392475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 195/397] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:56.400256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d652e-963e-42b0-a65f-d832dc6801af None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.400568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d652e-963e-42b0-a65f-d832dc6801af None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.400840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d652e-963e-42b0-a65f-d832dc6801af None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.402450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 196/398] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:34:56.420343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.420657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.420893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.430511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:56.456033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 203/399] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:56.456760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:56.458071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:56.536103 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 197/400] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:34:56.731880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:56.744113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:56.885090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9544-b955-4cbf-9aa5-e0622e9a541e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:56.890550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7cd3d-663c-45b9-a63d-4d4a813ac210 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:56.923753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:56.924991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.925459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.925919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.928064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:56.933848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:56.934509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:56.934817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:56.935089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:56.942488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:56.947177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:56.948186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:56.949246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:56.950219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:56.952160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:56.953277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 198/401] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:56.954232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:56.960050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 204/402] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:56.961196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:56.989852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.074127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eddded-c060-4f1a-9f11-0510ee78d868 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.080962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701591c-0b01-49d9-8a90-a5a971e73050 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.116622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.117532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.117954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.118843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.120041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:57.120481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.122678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.131147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.131771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 205/403] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.132233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.132576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.132920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.133482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.146763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:57.153028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:57.153932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:57.154760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 199/404] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:57.155529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.225971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.247674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.252350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e80cd7-35ac-4a3f-a539-292286e5e896 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.287066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.287824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.287943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.288199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.288853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] RBAC: Adding query filter params (name=member) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:57.289169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.290515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.291370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0da2e-2f7c-45c3-b24f-c5441493d75d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.299716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 206/405] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.300651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.336194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.338333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.338889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.339343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.340839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.342573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.346508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 200/406] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.347690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.416915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e2917-c9bb-4936-b2ce-9e79d381360b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.452207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.452825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.453098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.453366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.454033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:57.454339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.455736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.464994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 207/407] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.466032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.480409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.488767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbb4e8-72ae-4ca8-bf73-31efbcae5a19 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.512008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.531319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.532414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.532903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.533528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.535048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.537120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.539497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 201/408] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.540619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.580360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929265f1-03b2-4998-9c30-985cc818c4c9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.616764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.617393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.617663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.617927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.619160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.620604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.622242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 208/409] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.623112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.658387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f3fd0-3145-4be0-bbc8-ffbe92559283 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.696730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.697897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.698394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.698895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] PATH_INFO: `/v3/groups/6b6f3325a61649009f5f84b8c1b8b5a2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.700423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] RBAC: Authorizing `identity:get_group(group_id=6b6f3325a61649009f5f84b8c1b8b5a2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.701317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.703226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.705734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 202/410] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/groups/6b6f3325a61649009f5f84b8c1b8b5a2 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.706716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.730717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2fd5e-0def-4138-a549-7e06077300ee None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.769017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:57.771857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.772521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.772794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.773068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.779023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.780446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.782479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 209/411] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.783369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.821044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8a280-b193-4c39-b158-d3c64b4d6f08 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.857684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.858877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.859502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.860004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b/groups/78df46fb1660421cae10e26903106d14/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.862708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3226da393364c7098a6f7470d2e7c4b, group_id=78df46fb1660421cae10e26903106d14, role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.864645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.886039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 203/412] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 6 11:34:57 2022] PUT /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b/groups/78df46fb1660421cae10e26903106d14/roles/559beb10e54749d1b4ce94120725233a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:57.887612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.892479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae77f4-f864-4f6f-aa7b-66b10c05274e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:57.942454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:57.943179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:57.946730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:57.950018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] PATH_INFO: `/v3/projects/b38d4dcd6a0e45e880f97fafaba71561` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:57.952292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d4dcd6a0e45e880f97fafaba71561)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:57.953798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:57.955621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 210/413] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:34:57 2022] GET /identity/v3/projects/b38d4dcd6a0e45e880f97fafaba71561 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:57.965821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:57.999072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:58.078909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe44c50-0577-478a-ac0e-d0b434cdaaf2 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:58.104174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:58.131168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f08bd0-5fc0-4c3d-98f7-7c04083da188 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:58.136343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737215-d882-4f57-bc5c-c08fbc22b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:58.137045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737215-d882-4f57-bc5c-c08fbc22b168 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:58.137321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737215-d882-4f57-bc5c-c08fbc22b168 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:58.137598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737215-d882-4f57-bc5c-c08fbc22b168 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b/groups/78df46fb1660421cae10e26903106d14/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:58.139588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08737215-d882-4f57-bc5c-c08fbc22b168 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3226da393364c7098a6f7470d2e7c4b, group_id=78df46fb1660421cae10e26903106d14, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:58.141062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08737215-d882-4f57-bc5c-c08fbc22b168 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:58.168133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa5b7-1a36-4b7e-8d1b-c63c3ab4ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:58.168822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa5b7-1a36-4b7e-8d1b-c63c3ab4ad77 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:58.169096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa5b7-1a36-4b7e-8d1b-c63c3ab4ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:58.169364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa5b7-1a36-4b7e-8d1b-c63c3ab4ad77 None admin] PATH_INFO: `/v3/projects/b38d4dcd6a0e45e880f97fafaba71561/groups/6b6f3325a61649009f5f84b8c1b8b5a2/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:58.174020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efa5b7-1a36-4b7e-8d1b-c63c3ab4ad77 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d4dcd6a0e45e880f97fafaba71561, group_id=6b6f3325a61649009f5f84b8c1b8b5a2, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:58.175509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efa5b7-1a36-4b7e-8d1b-c63c3ab4ad77 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:58.180471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 204/414] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 6 11:34:57 2022] PUT /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b/groups/78df46fb1660421cae10e26903106d14/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:58.203645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 211/415] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 6 11:34:57 2022] PUT /identity/v3/projects/b38d4dcd6a0e45e880f97fafaba71561/groups/6b6f3325a61649009f5f84b8c1b8b5a2/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:58.379868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1248a8-4380-4a98-9762-a5c3d6491eb2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:58.380257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1248a8-4380-4a98-9762-a5c3d6491eb2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:58.380369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1248a8-4380-4a98-9762-a5c3d6491eb2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:58.382054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 205/416] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:58.387766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e98c-24f6-4f6e-b7d0-8110cee15f11 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:58.388306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e98c-24f6-4f6e-b7d0-8110cee15f11 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:58.388306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e98c-24f6-4f6e-b7d0-8110cee15f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:58.408770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3510e98c-24f6-4f6e-b7d0-8110cee15f11 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:58.409998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3510e98c-24f6-4f6e-b7d0-8110cee15f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:58.482159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 212/417] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:58.525133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841df8-a25a-4e99-b986-150deed8aa0c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:58.525690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841df8-a25a-4e99-b986-150deed8aa0c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:58.525690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841df8-a25a-4e99-b986-150deed8aa0c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:58.527193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 206/418] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:34:58.536148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:58.536148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:58.536148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:58.541288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:58.553711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:58.555148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:58.650357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 213/419] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:34:58.930539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841df8-a25a-4e99-b986-150deed8aa0c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:58.988790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:59.189146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841df8-a25a-4e99-b986-150deed8aa0c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:59.251781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:59.252832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.252956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d338f7-a057-4b30-8d39-6853249e4ed3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:59.253309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.253783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:59.272410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:59.282053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:59.283036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:34:59.283872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:34:59.284514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 207/420] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:59.291344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:59.335721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:59.336366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.336640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.336899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:59.342515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:59.360740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:34:59.364977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:34:59.374390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:34:59.375346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:34:59.376135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 214/421] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:34:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:34:59.383720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:59.454810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edebc5e-39ea-46a3-92f2-d1fa4db47746 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:59.537078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:59.537779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.538015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.538816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:59.539000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:59.539302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:59.540711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:59.550793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 208/422] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:59.556365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:59.605398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb53f7-e8b7-416b-8ef0-4c8d3884266b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:59.685779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:59.686427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.686724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.687004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:59.687716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:59.688019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:59.689519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:59.716088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 215/423] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:59.722299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:59.761658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:59.767875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249cebb-c279-4a19-853b-72402620f790 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:59.805864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:59.808200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:59.809088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.809559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.810028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:59.892779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4aa9-3407-4a6a-acd8-4098c9b5555f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:59.919903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:59.921608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:59.941737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b060502-a25a-4e8c-832b-1dade5bc877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:59.942408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060502-a25a-4e8c-832b-1dade5bc877e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.942695 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060502-a25a-4e8c-832b-1dade5bc877e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.942973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060502-a25a-4e8c-832b-1dade5bc877e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.084678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b060502-a25a-4e8c-832b-1dade5bc877e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.087870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b060502-a25a-4e8c-832b-1dade5bc877e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.104619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.113086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 209/424] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 11:35:00.119371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.191535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.238271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 216/425] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:00.240681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd576e6d-b0d8-4981-8b28-beff5852719f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.244225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b52e9-8b43-4685-91d6-802ed2624c0e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.244510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b52e9-8b43-4685-91d6-802ed2624c0e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.244783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b52e9-8b43-4685-91d6-802ed2624c0e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.250262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 217/426] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:00.250262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b52e9-8b43-4685-91d6-802ed2624c0e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.282950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d5ee1-cfb0-4666-9bd5-e98f733749d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.284002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5ee1-cfb0-4666-9bd5-e98f733749d8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.284288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5ee1-cfb0-4666-9bd5-e98f733749d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.284558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5ee1-cfb0-4666-9bd5-e98f733749d8 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.285746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d5ee1-cfb0-4666-9bd5-e98f733749d8 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.287330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d5ee1-cfb0-4666-9bd5-e98f733749d8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.289536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 210/427] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:00.290789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.291069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.291338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.310489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:00.311861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:00.357570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b52e9-8b43-4685-91d6-802ed2624c0e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.383310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 211/428] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:00.384155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.387043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.394199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.395389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.395894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.396355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] PATH_INFO: `/v3/projects/f2f98a274c514a69adb9c210ec141387` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.397790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] RBAC: Authorizing `identity:get_project(project_id=f2f98a274c514a69adb9c210ec141387)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.399563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.401745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 218/429] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/projects/f2f98a274c514a69adb9c210ec141387 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:00.407512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.434022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.522744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca76422-9494-47eb-8e17-3700b6945948 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.562004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58701a-4389-4141-a7b5-c801fb3933d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.562750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58701a-4389-4141-a7b5-c801fb3933d6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.562992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58701a-4389-4141-a7b5-c801fb3933d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.563227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58701a-4389-4141-a7b5-c801fb3933d6 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.564389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58701a-4389-4141-a7b5-c801fb3933d6 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.565923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58701a-4389-4141-a7b5-c801fb3933d6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.566537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0c915-1c92-4ba7-81c1-2ada429bb214 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.567644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 212/430] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:00.573692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d88493-5f1e-4eca-82aa-254c80532ca0 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.573963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d88493-5f1e-4eca-82aa-254c80532ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.574240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d88493-5f1e-4eca-82aa-254c80532ca0 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.575854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 213/431] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:00.576567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d88493-5f1e-4eca-82aa-254c80532ca0 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.606315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01fd53-c078-4f84-8ea5-76b18f4d5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.607797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fd53-c078-4f84-8ea5-76b18f4d5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.608289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fd53-c078-4f84-8ea5-76b18f4d5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.608778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fd53-c078-4f84-8ea5-76b18f4d5ef1 None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.610161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01fd53-c078-4f84-8ea5-76b18f4d5ef1 None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.611881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01fd53-c078-4f84-8ea5-76b18f4d5ef1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.614148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 219/432] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:00.620228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.620979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.621470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.640461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:00.641686 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:00.650947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.699896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d88493-5f1e-4eca-82aa-254c80532ca0 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.722193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 220/433] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:00.723623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.746549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.747446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.747907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.748328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.749206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=f2f98a274c514a69adb9c210ec141387) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:00.749661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.751340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821ab8-bebd-4803-84fd-7c7045b790dc None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.757765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 214/434] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:00.759020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6611311-fa4a-46cf-92e7-2251e826fd26 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.759305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6611311-fa4a-46cf-92e7-2251e826fd26 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.759578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6611311-fa4a-46cf-92e7-2251e826fd26 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.765000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 215/435] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:00.765000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6611311-fa4a-46cf-92e7-2251e826fd26 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:00.768976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.868953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598dc2-d5c3-4f90-b218-d3570a09677a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.915572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6611311-fa4a-46cf-92e7-2251e826fd26 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:00.917901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.919499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.919774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.920044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.920942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=f2f98a274c514a69adb9c210ec141387) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:00.921110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:00.922526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68796-1a8d-45a3-b6e1-f855dc3b25d8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:00.930392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 221/436] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=f2f98a274c514a69adb9c210ec141387&role.id=559beb10e54749d1b4ce94120725233a => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:00.940400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.940679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.941101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.955358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.967037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:00.967613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:00.967874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:00.968221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:00.968555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:00.969824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:00.986205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:00.991889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:00.992901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:00.993702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 216/437] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:00.994356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.060810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 222/438] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:01.067657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.096006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.131697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52fad5-d189-4744-944b-5b357af41db0 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.181117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.181763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.182077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.182351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.196284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:01.198799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ccadc-77df-40db-af6f-626b3f4042e3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:01.203535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:01.204458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:01.205265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 217/439] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:01.210581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.245035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.245654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.246033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.246217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.246912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:01.247184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.248548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.258315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 223/440] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:01.265380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.274290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.337869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376ec0-1745-4c7f-8f3c-3c10c1dd66d3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.363672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.378662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.379469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.379740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.380009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.381197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] RBAC: Adding query filter params (name=member) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:01.381197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.382373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.393058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 218/441] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:01.394176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.406674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29833b49-d34b-4bf9-a2b8-6bad4c5d5845 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.453365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.453698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.453975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.454250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.536129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587079c-332d-47b1-9f60-7644affa8428 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.544659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.546129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.549071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.578552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.580006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.580279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.580550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.591661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:01.597366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:01.598533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 219/442] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:01.599771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.634751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.663540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 224/443] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 11:35:01.669219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.707168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4abbe-7646-43b7-9e16-c21563ace7fc None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.745379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.746010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.746267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.746535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.775424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8baa-cb17-434b-9e88-7e6754940a30 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.788641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.814113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.814753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.815096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.815365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.816053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:01.816345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.817786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.821953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.823469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.830396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 225/444] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:01.830396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.868933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:01.938871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba1cf5-6ae7-499b-b7c3-bf96e5f4991f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.941059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 220/445] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:01.941922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.978738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.979383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.979659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.979935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.981080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.982547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.984218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 226/446] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:01.984975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.017781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.048689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf734c-4f5a-4284-bc71-22eaa701d89b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.083304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.083920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.084199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.084462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.086754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496236cf-9152-4971-b96b-b74020d2f853 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.096622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.121878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.122507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.122816 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.123089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] PATH_INFO: `/v3/projects/c3226da393364c7098a6f7470d2e7c4b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.124268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] RBAC: Authorizing `identity:get_project(project_id=c3226da393364c7098a6f7470d2e7c4b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.125710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.127399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 227/447] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/projects/c3226da393364c7098a6f7470d2e7c4b => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:02.128269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.155031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.156496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.228767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.235819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12e08-7f8e-4c7f-84e6-e99b1e949740 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.270389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.271057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.271335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.271606 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.272234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 221/448] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:02.272767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.273076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.274214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.275927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 228/449] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:02.278022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.329317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.392287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e59fd-d23a-44c9-8792-a9b91a64845b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.392861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda356-3e3b-4bf4-9dc3-b423642058e3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.429559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.430039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.430193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.434279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.434404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.434486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] PATH_INFO: `/v3/projects/b38d4dcd6a0e45e880f97fafaba71561` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.434568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.434568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] PATH_INFO: `/v3/groups/78df46fb1660421cae10e26903106d14` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.434774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d4dcd6a0e45e880f97fafaba71561)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.434859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] RBAC: Authorizing `identity:get_group(group_id=78df46fb1660421cae10e26903106d14)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.434942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.435018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.435396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 229/450] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/projects/b38d4dcd6a0e45e880f97fafaba71561 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:02.436176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.439012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 222/451] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/groups/78df46fb1660421cae10e26903106d14 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:02.443901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.494208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.548062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1916-f03f-4240-ad47-9cf0c5caea98 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.557921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cab767-f222-4b69-a9e9-ba4414a4d73d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.562700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.588423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.589036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.589308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.589549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.590297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=c3226da393364c7098a6f7470d2e7c4b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:02.590593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.592102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.595753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.596378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.596647 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.596912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] PATH_INFO: `/v3/groups/6b6f3325a61649009f5f84b8c1b8b5a2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.598052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] RBAC: Authorizing `identity:get_group(group_id=6b6f3325a61649009f5f84b8c1b8b5a2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.598485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 230/452] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=559beb10e54749d1b4ce94120725233a => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:02.599144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.599490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.601055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 223/453] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/groups/6b6f3325a61649009f5f84b8c1b8b5a2 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:02.607384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.729118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b86d-33fc-4170-bf69-da98eca0d91d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.729602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99bbcd-e027-4e79-aecc-497ce4991016 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.740694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.770528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.774229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.774229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.774229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.774229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] RBAC: Adding query filter params (group.id=6b6f3325a61649009f5f84b8c1b8b5a2, role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=b38d4dcd6a0e45e880f97fafaba71561) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:02.774229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.774229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288d415-a92f-4b97-9a8a-3e720ec99c46 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.774637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.778089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.778089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.778089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.778089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] RBAC: Adding query filter params (group.id=78df46fb1660421cae10e26903106d14, role.id=7a9fe76f438347f8a55ca531d152d5c2, scope.project.id=c3226da393364c7098a6f7470d2e7c4b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:02.778089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.778089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da19c88-89fe-44ef-b45b-d56e43710a3e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.780815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 224/454] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/role_assignments?group.id=6b6f3325a61649009f5f84b8c1b8b5a2&scope.project.id=b38d4dcd6a0e45e880f97fafaba71561&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:02.787678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 231/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/role_assignments?group.id=78df46fb1660421cae10e26903106d14&scope.project.id=c3226da393364c7098a6f7470d2e7c4b&role.id=7a9fe76f438347f8a55ca531d152d5c2 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:05.394372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6b914-2a82-4b57-9ed0-a6ca3902dd97 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.395121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6b914-2a82-4b57-9ed0-a6ca3902dd97 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.395121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6b914-2a82-4b57-9ed0-a6ca3902dd97 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.396654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 225/456] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:05.403685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d8b25-4a3d-4213-89e7-57491ff03e4d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.404214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d8b25-4a3d-4213-89e7-57491ff03e4d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.404214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d8b25-4a3d-4213-89e7-57491ff03e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.435874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2c7d8b25-4a3d-4213-89e7-57491ff03e4d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:05.437102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2c7d8b25-4a3d-4213-89e7-57491ff03e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:05.475411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:05.517466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 232/457] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:05.674458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d6abe-d841-4b86-853d-2b3be9d982e2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.674847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d6abe-d841-4b86-853d-2b3be9d982e2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.675067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d6abe-d841-4b86-853d-2b3be9d982e2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.676750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 226/458] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:05.690375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.690375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.690375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.719961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:05.721558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:05.817013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 233/459] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:05.930229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d6abe-d841-4b86-853d-2b3be9d982e2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.076725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d6abe-d841-4b86-853d-2b3be9d982e2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.128687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44445-099e-41bc-840d-77677750394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.129406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44445-099e-41bc-840d-77677750394b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.129681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44445-099e-41bc-840d-77677750394b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.129948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44445-099e-41bc-840d-77677750394b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.138388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.146451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd44445-099e-41bc-840d-77677750394b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.148062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd44445-099e-41bc-840d-77677750394b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-cdd44445-099e-41bc-840d-77677750394b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:06.166738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:06.167738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:06.168610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:06.168610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:06.168610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:06.168782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 227/460] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:06.174069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44445-099e-41bc-840d-77677750394b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.207142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:06.279972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:06.283400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fa74c-4acc-4ea7-9d93-da520bdf3131 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.309612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44445-099e-41bc-840d-77677750394b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.323137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.324215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.324625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.325258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.350560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.352152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.353283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.354206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.354543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.354896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.356015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:06.356396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.357846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d93bda9c-9064-413e-a0aa-0db199d10726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:06.370919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:06.372072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:06.373705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:06.373705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:06.373705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:06.374083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 234/461] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:06.378714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9e061-f39e-4b71-a45e-9c9552f3898b None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.378714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9e061-f39e-4b71-a45e-9c9552f3898b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.378714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9e061-f39e-4b71-a45e-9c9552f3898b None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.378714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 235/462] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:06.379057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 228/463] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:06.383115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9e061-f39e-4b71-a45e-9c9552f3898b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.383346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.474949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:06.503009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b7e6-74d9-4483-91b2-f3b17af8a50a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.509680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9e061-f39e-4b71-a45e-9c9552f3898b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.543347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.543968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.544249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.544519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.545168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:06.545474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.546908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f9bb1-8df6-4e80-9e8a-8f63b4353be2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.556960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ca4d2-3d96-4f3f-81a1-706fb17e0152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.557573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ca4d2-3d96-4f3f-81a1-706fb17e0152 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.557868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ca4d2-3d96-4f3f-81a1-706fb17e0152 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.558118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ca4d2-3d96-4f3f-81a1-706fb17e0152 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.558835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ca4d2-3d96-4f3f-81a1-706fb17e0152 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.564676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 229/464] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:06.564836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ca4d2-3d96-4f3f-81a1-706fb17e0152 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.564914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee9ebc-2bd6-43e2-aef9-9479abbeb29b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.564914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee9ebc-2bd6-43e2-aef9-9479abbeb29b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.564914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee9ebc-2bd6-43e2-aef9-9479abbeb29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.580504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-edee9ebc-2bd6-43e2-aef9-9479abbeb29b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:06.581695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-edee9ebc-2bd6-43e2-aef9-9479abbeb29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:06.591300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 236/465] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:35:06.591300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8ee9-dde6-48df-886c-dce73a4ff8f4 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.591300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8ee9-dde6-48df-886c-dce73a4ff8f4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.591300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8ee9-dde6-48df-886c-dce73a4ff8f4 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.591300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 237/466] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:06.591300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb8ee9-dde6-48df-886c-dce73a4ff8f4 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.608240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:06.679763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 230/467] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:06.681331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3da03-b3d5-4e9a-a127-f361e9835453 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.681712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3da03-b3d5-4e9a-a127-f361e9835453 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.682099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3da03-b3d5-4e9a-a127-f361e9835453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.716042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-efd3da03-b3d5-4e9a-a127-f361e9835453 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:06.717390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-efd3da03-b3d5-4e9a-a127-f361e9835453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:06.736986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb8ee9-dde6-48df-886c-dce73a4ff8f4 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.801200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2524ea1-ecce-4e65-ba16-784172515bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.801853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524ea1-ecce-4e65-ba16-784172515bc7 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.802185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524ea1-ecce-4e65-ba16-784172515bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.802456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524ea1-ecce-4e65-ba16-784172515bc7 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.803149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524ea1-ecce-4e65-ba16-784172515bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.804598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524ea1-ecce-4e65-ba16-784172515bc7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.833823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 238/468] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:06.837149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 231/469] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:06.989358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097155d6-a01a-4f86-8cb0-5e792749a2b1 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.989723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097155d6-a01a-4f86-8cb0-5e792749a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.989951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097155d6-a01a-4f86-8cb0-5e792749a2b1 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.991664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 239/470] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:06.996961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.997519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.997969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.004034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097155d6-a01a-4f86-8cb0-5e792749a2b1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.005863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.023776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:07.025611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:07.077094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.121780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 232/471] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:07.129147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097155d6-a01a-4f86-8cb0-5e792749a2b1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.132204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.175128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.175926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.176268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.176605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.189841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.191459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:07.209271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:07.210248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:07.211418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:07.211418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:07.211418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:07.213256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 240/472] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:07.219355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.298038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0cdec-3a57-4c62-9b37-110f65120c8e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.347143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.357205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.357911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.358190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.358457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.388964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.390457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.391308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26937a-1df6-495f-a9a2-277a8484a822 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:07.414089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:07.415114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:07.415977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:07.415977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:07.415977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:07.415977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 233/473] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:07.416842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.420379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.430891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.431676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.432057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.432430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.433191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:07.433581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.435088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.454777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 241/474] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:07.455669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.534110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62321f-99b3-45bc-86ff-8ca104b30db8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.564597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f133-452e-4110-881f-4dd993c3387e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.571852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.572681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.573183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.573594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.574417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.576087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.584542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.sql.core [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 11:35:07.584542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 11:35:07.584542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [parameters: {'id': '0317457e898d40bfbb8aa9b15d413618', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 11:35:07.584542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88032) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 11:35:07.602081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.602749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.603040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.603312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.603965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:07.604267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result.read() Sep 06 11:35:07.604626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:35:07.605682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application yield resource Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise self.value Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application session.commit() Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 11:35:07.606842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.session.flush() Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application compat.raise_( Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 11:35:07.607778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:35:07.608753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result.read() Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:35:07.609773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [parameters: {'id': '0317457e898d40bfbb8aa9b15d413618', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:07.610822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 11:35:07.611631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:07.612428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.614105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 234/475] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 6 11:35:07 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:07.615278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.620208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 242/476] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:07.621127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.658088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.673790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.733386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fee3e-0a31-4c25-a661-dbefafb35fd9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.736541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd6508-0572-44ba-a483-45c8e6a65175 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.770740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.771461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.771741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.772013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.778052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.778870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.779294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.779708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.780519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.782110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.784974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:07.789916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:07.791064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:07.792033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 243/477] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:07.792721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.810629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 235/478] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:35:07 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:07.811866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:07.928655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19e394-5a9e-4c47-8041-501b908d2800 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.932483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.936593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:07.954132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757bf21-d393-46d0-a9ba-e62c15eb55d0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:07.974851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:07.975861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:07.976317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:07.976790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:07.977656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:07.978138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:07.979767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bd20-62ec-47af-9eba-4e703a9c7ea1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:07.990159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 236/479] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:08.013120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edbc2f-9f16-4da0-b0b7-d3d774290bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:08.014102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbc2f-9f16-4da0-b0b7-d3d774290bd8 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:08.014562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbc2f-9f16-4da0-b0b7-d3d774290bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:08.015040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbc2f-9f16-4da0-b0b7-d3d774290bd8 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:08.015897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edbc2f-9f16-4da0-b0b7-d3d774290bd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:08.017789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edbc2f-9f16-4da0-b0b7-d3d774290bd8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:08.045428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 244/480] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:35:07 2022] POST /identity/v3/users => generated 249 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:09.293974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4037-aa8f-4b1b-824e-46abdbd5cdc2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:09.294533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4037-aa8f-4b1b-824e-46abdbd5cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:09.294533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4037-aa8f-4b1b-824e-46abdbd5cdc2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:09.296140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 237/481] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:09.302043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:09.302574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:09.302574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:09.315475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af18d3b-3b31-478e-b3fc-4fe14ab9d9e7 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:09.315822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af18d3b-3b31-478e-b3fc-4fe14ab9d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:09.316041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af18d3b-3b31-478e-b3fc-4fe14ab9d9e7 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:09.317787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 238/482] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:09.323393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:09.323521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:09.323726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:09.323948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:09.324713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:09.342220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:09.343541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:09.433227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 245/483] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:35:09.471090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 239/484] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:35:09.775534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:09.842646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:09.886626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:09.914629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959782b4-bff8-44bf-97ca-ddfd675f2b04 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:09.961684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:09.962335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:09.962611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:09.962910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:09.988155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:09.997212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:09.998129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:09.999055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 246/485] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:10.005629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.015053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.017479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1606e6-c6b2-4c67-afbb-f0d73546da8f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.085291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.085997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.086255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.086624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.110021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:10.118269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:10.120459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:10.122521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 240/486] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:10.142749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.218589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f6a2-97cb-498d-bf4a-8984f7ff2e65 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.256827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.257360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.257639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.257905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.258578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:10.258903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.260369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506fad9-b271-4214-91a7-6b122caf29f9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.269410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 247/487] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:10.270799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb796-6ab6-4c91-8543-d06c473b3b8a None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.271129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb796-6ab6-4c91-8543-d06c473b3b8a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.271406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb796-6ab6-4c91-8543-d06c473b3b8a None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.272616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 248/488] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:10.275739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e226-859f-402d-96f2-3d0296e8e86b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.278031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaddba-3318-46b4-afc1-0f678d5d06e9 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.278387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaddba-3318-46b4-afc1-0f678d5d06e9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.278767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaddba-3318-46b4-afc1-0f678d5d06e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.286252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.299945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8ffaddba-3318-46b4-afc1-0f678d5d06e9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:10.301184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8ffaddba-3318-46b4-afc1-0f678d5d06e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:10.312449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.313082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.313321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.313590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.314254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:10.314555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.316126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.325134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 241/489] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:10.325970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.348248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.378887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 249/490] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:10.381063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58815-32c9-4fb9-a181-23fd105bf496 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.381347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58815-32c9-4fb9-a181-23fd105bf496 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.381622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58815-32c9-4fb9-a181-23fd105bf496 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.383032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 250/491] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:10.383631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58815-32c9-4fb9-a181-23fd105bf496 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.449918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7c62-7aa5-4e80-b495-70ecaaa9e268 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.485594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.486231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.486559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.486889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.498474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.499855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-fd35a03f-aa9f-4311-91b2-5913bcfab880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:10.515932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:10.516883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:10.517740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:10.517740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:10.517740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:10.517740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 242/492] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:10.518709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.518982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.519248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.524073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58815-32c9-4fb9-a181-23fd105bf496 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.539182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:10.540586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:10.570407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.571604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.572466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.572920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.575639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.591471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.593735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.611508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.617265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 243/493] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:10.617805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:10.618742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:10.619614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:10.619614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:10.619614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:10.619777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.621547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 251/494] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:10.629075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.752837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b540c4-65e6-46d3-bd13-9455f4ddc74e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.753241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c7af-33d9-4c9a-93e0-499771dc4f4b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.795375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.795899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.796175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.796442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.797525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:10.797828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.799434 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.815951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 252/495] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:10.815951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.817161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.817871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.818136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.818404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.819082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:10.819386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.820825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed893-2033-437e-b74b-62b535ed2f23 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.832681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 244/496] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:10.837243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b3cc-577c-452f-8208-0025fd4fd0f3 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.837243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b3cc-577c-452f-8208-0025fd4fd0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.837243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b3cc-577c-452f-8208-0025fd4fd0f3 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.837243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 245/497] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:10.837243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b3cc-577c-452f-8208-0025fd4fd0f3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.872952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.899930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.928789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f370e0-1f53-47bd-b6dc-988d380066bd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.941349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b3cc-577c-452f-8208-0025fd4fd0f3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:10.962781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.963417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.963694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.963965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.974337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.975859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.976109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:10.976740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:10.977012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:10.977274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] PATH_INFO: `/v3/users/nova` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:10.984627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:10.986059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:10.990294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:10.991227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:10.992056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:10.992056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:10.992056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:10.992056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 253/498] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:10.992278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-57df2a12-5f68-4adb-82c8-bb2f07d0f6de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:10.999854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:11.000881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:11.001781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 246/499] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:11.002525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.002781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.003021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.021270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:11.022462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:11.088561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.092223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b220e-7384-4124-9e4f-6462979db8a8 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.106887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 247/500] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:11.108084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.137006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.137650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.137932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.138204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.145989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.147496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:11.160411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:11.161387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:11.162356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 254/501] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:11.162979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.171631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.227135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d7537-554a-4854-8555-d70714cc6d39 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.264746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.264979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd39e7-78c5-4cf9-abfc-baef4b5af7a7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.265383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.265662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.265932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.276735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:11.281481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:11.282402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:11.283245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 248/502] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:11.283915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.307985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.308608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.309056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.309335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.309994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:11.310300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.311896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.324678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 255/503] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:11.325502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.347314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.395575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb052-0108-4dee-8fd5-b5a12fcc344d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.406561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.431447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d02381-ce10-4b73-873f-29e85565ae2f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.432032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.432300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.432572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.432817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.433575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:11.433869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.435344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.465819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.466420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.466709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.466984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.467706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:11.468003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.469430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.472309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 249/504] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:11.473072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.506238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 256/505] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:11.507248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.579348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37f112-aa7a-4ec4-951b-d3be82a6e81f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.589432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.613988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.614156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718422f6-c2d2-412f-a72b-59301d8c51e3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.614999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.615306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.615574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.616235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:11.616540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.617972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.626209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 250/506] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:11.627057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.651427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.652044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.652323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.652788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.653238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.654759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.658965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.676263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 257/507] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:35:11 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:11.677382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.748616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c9f4-c456-4169-a319-c05343778a4b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.787035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.787688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.787975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.788242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.800927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:11.806536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:11.807660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:11.808560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 251/508] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:11.809270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:11.815318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1e5b-7861-4cc6-af69-4a70fa84c29b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.847997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.854336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.855133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.855590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.855921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:11.914719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:11.925963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b423cbd-c1d2-4102-8455-8169f3c0085e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:11.936611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:11.938316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:11.963050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:11.964140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:11.964418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:11.964680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.039315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.040792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.049421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 258/509] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:12.049421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.080101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.145517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.161107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 252/510] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:12.162400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.168300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dba48-93e4-48f7-a38e-6c01e40e0a09 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.206997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.207640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.207916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.208183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.220054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.221994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:12.237241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:12.238209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:12.239076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:12.239076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.239076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:12.239076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 259/511] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:12.239306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.272800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee22970-449a-4595-87be-06ed0786a85f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.309290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.309893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.310164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.310424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.311097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:12.311391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.312838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.326397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 253/512] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:12.326397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.328091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.340029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370865f-f6fb-4498-b20c-8b757762e79b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.377584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.378216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.378489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.378782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.389726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.391209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.398141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:12.406166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:12.407287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:12.411831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:12.411831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.411831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:12.411831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 260/513] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:12.411831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.461797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9e63-aef8-4381-8ddf-8a3aaf22abc5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.496733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.497366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.497637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.497902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.509303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.510807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.521150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976edf9-fca3-485f-91ee-aa3a29262fce None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:12.526769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:12.527654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:12.533859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:12.533859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.533859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:12.533859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 254/514] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:12.533859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.570659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.571295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.571570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.571835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.572493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:12.573576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.575401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.580395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.596745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 261/515] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:12.598349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.644389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb9c1c-c682-40b9-998e-c513c01b01a9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.646836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.681128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.681767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.682050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.682313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.693021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.694495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.704109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57becd2-72e7-413f-bc44-7006ef4c6e4e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:12.709402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:12.710334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:12.711846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:12.711846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:12.711846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:12.715371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 255/516] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:12.716308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.749788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.750423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.750698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.750975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.751626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:12.751926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.753328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.764975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 262/517] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:12.765795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.825204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.837421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5103-e59c-42e9-bd12-60fe494ca9c0 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.871759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221568d9-b090-4dbf-b266-b0f4a9c1d027 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:12.876615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.877282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.877555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.877859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.878520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:12.878850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.880312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.897611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 256/518] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:12.897611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:12.913030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:12.913667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:12.913941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:12.914198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:12.915635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.922877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:12.924641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:12.935987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:12.936899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:12.937785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 263/519] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:12.938340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.015410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908062b-23d7-4726-bc73-8fe97372369b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.050817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfd10f-b083-43ab-8e57-51f17f357377 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.052368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.052982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.053259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.053534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.054166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.054462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.056224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.074946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.076540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 257/520] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.077916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.098806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.099487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.099750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.100022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.108082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.109547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:13.122523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:13.123581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 264/521] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:13.125051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.166357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.193237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ab98-bb53-4ec1-92a4-4fa6a43cc847 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.230784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281823-c94e-4131-a8df-d9e86bd1059e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.232824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.233774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.234120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.234455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.242731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.244189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:13.256272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:13.257195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:13.258046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 258/522] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:13.258505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.271582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.271860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.272297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.272404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.273109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.273412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.274891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.293537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 265/523] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.294368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.328369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.375055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bbba1-bbf8-4e39-bcaa-1a35723c816e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.398724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421049c-2fe7-426a-bca8-65391920012c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.412934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.414317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.414797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.415240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.418710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.425474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.428070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.435352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.435959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.436233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.436492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.437181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.437480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.438943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:13.439044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:13.439888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 259/524] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:13.445829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.464292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 266/525] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.465150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.555006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c21c00-7d36-4e04-b86d-c929bb2696d3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.564893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.572947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8549ff-1d48-42d8-a696-3ddc1b296954 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.593215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.593838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.594118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.594382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.595612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.595791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.597300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.607799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.608882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.609160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.609431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.616189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 260/526] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.617348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.677345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.677658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.678965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.722954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf2214-bc23-4b9a-9184-0aa0c7b91f07 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.759748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.760374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.760649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.760913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.761646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.761949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.763442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.775028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.780885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 261/527] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.781701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.787412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 267/528] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:13.787412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.883145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62e9a-159d-4f7a-b6c5-1c664a6bb5bf None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.883771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec49821-21d3-476e-9216-82149f47cb8e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:13.897751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:13.919997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.920222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:13.920608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.920719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.920881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.920974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.921140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.921238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.921862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=a782787a64c94d0f8a43f7f8deeb120b) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.921969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=8aaccbf6e1e746f5b7285d57564d9d5d) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:13.922161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.922271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:13.923626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649ffb3-e488-4e84-aee7-799ceaf6d499 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.923727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:13.929403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 262/529] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/role_assignments?user.id=a782787a64c94d0f8a43f7f8deeb120b&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.936078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 268/530] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/role_assignments?user.id=8aaccbf6e1e746f5b7285d57564d9d5d&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:13.936078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:13.936278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61ee5e-2adb-4d37-ad9e-aec4061614ab None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:13.936278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61ee5e-2adb-4d37-ad9e-aec4061614ab None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:13.936278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61ee5e-2adb-4d37-ad9e-aec4061614ab None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:13.936278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 263/531] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:13.936278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61ee5e-2adb-4d37-ad9e-aec4061614ab None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.013556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.062540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975784d-94ab-44f0-88ba-466822f96daf None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.074673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61ee5e-2adb-4d37-ad9e-aec4061614ab None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.108326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.108326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.110122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.110122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.117280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.117930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.118254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.118532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.130387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:14.132106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-6fc391f0-4393-4a0f-a3f6-66534930b6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:14.148567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:14.149497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:14.150340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:14.150340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:14.150340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:14.150340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 264/532] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:14.151013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.151122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.152243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.171306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:14.172657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:14.183341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:14.185165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:14.199225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.252909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.259981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 265/533] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:14.261771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.319222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 269/534] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:14.324696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.439744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52074-d125-4eff-9c95-c5c9d8187d62 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.488010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.488658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.488932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.489190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.515608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:14.517094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:14.519624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12811b-9a1c-4991-a552-47a13eb3acbf None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:14.554560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:14.555565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:14.556413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:14.556413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:14.556413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:14.556413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 270/535] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:14.564874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.585889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.603459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.604094 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.604367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.604635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.605291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:14.605594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:14.607024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:14.626427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 266/536] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:14.627418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.654292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.708759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757ad65-0eb0-4ec6-8d90-0e548208bde8 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.745649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.746500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.746992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.747407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.748272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:14.748788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:14.750375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:14.762768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2c46-a65c-40bf-8956-7ed0be24860b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.763689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 271/537] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:14.764808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.816748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.817585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.818041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.818332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.833316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:14.840851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:14.841826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:14.842657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 267/538] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:14.843378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.853749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.901228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec52ed-19a5-452f-960b-179f3be83a0e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:14.947762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:14.948408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:14.948685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:14.948955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:14.956185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:14.957649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:14.958086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:14.970805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:14.971768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 272/539] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:14.972621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:14.980624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5ff67-b22c-4853-b4a1-93c9dbf28f87 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.019337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.020099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.020372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.020679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.028275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.029928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:15.043092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:15.043979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 268/540] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:15.046020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.091011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3ef18-0e80-4f77-8e5a-d5c305814b1c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.129447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:15.139195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.139940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.140220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.140487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.141152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:15.141948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.143849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.154810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 273/541] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:15.156000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.169098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6fb06-78d5-43f4-a196-0c685842fa5f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.207881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.208615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.208940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.209209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.209904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:15.210208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.211704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.222574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:15.226902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 269/542] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:15.227971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.298610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7ff8a-a0f0-4ad4-a764-6152a0df9e06 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.334083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21b5ff-a06a-473f-a8b0-6894413c4c66 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.342942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.343973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.344262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.344532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.345983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:15.346290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.348115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.361198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 274/543] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:15.362110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.379183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.380249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.380947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.381406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.396229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.398314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.417993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:15.419310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:15.420579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:15.421420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:15.421420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:15.421420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:15.422964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 270/544] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:15.424060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.473105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0dec7-01a2-492d-a6ab-3c72994ef1f0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.482302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:15.510845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.511634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.511980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.512357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.513210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=76c4d2542f6145c38255de0387094e1e) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:15.513624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.515268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.521775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 275/545] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/role_assignments?user.id=76c4d2542f6145c38255de0387094e1e&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:15.522331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.535531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb752bdc-5623-49d4-b971-74d65c040300 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.574860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.575932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.576398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.576855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.577772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=ac866c0c1c33423b9ecbf97a3b08240c) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:15.578284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.579978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.586533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 271/546] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/role_assignments?user.id=ac866c0c1c33423b9ecbf97a3b08240c&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:15.643247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b318e8-1552-4b2e-9899-50bc09a68366 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.663119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:15.684714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.685352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.685631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.685901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.686567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:15.686900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.688490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.703920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 276/547] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:15.709637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:15.848501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ee6a-188d-4038-9026-591761a46f7f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:15.866269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:15.886252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:15.887260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:15.887728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:15.888179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:15.896922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:15.898830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-96887728-bbff-456b-bcad-1138d5b93bf1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:15.911131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:15.912177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:15.913794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:15.916382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 272/548] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:15.922055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.066173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f784287-4bb2-4cfc-bae5-c33e8e8bce96 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.066699 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f784287-4bb2-4cfc-bae5-c33e8e8bce96 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.067125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f784287-4bb2-4cfc-bae5-c33e8e8bce96 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.069007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 273/549] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:16.074280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eff3e-b3df-443d-bfb8-7279eb047236 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.074567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eff3e-b3df-443d-bfb8-7279eb047236 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.074886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eff3e-b3df-443d-bfb8-7279eb047236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.083197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee671dca-80cf-4b1c-867a-f91423485aa7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:16.108533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5c8eff3e-b3df-443d-bfb8-7279eb047236 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:16.109687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5c8eff3e-b3df-443d-bfb8-7279eb047236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:16.132689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:16.133851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.134134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.134408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.135447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:16.135759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:16.138136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ccdfa-89ea-4fc9-aa06-89071e060621 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:16.162783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 277/550] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Sep 6 11:35:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:16.164103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a73c-6b1b-4873-8649-f482d725e22b None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.164381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a73c-6b1b-4873-8649-f482d725e22b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.164697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a73c-6b1b-4873-8649-f482d725e22b None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.166158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 278/551] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:16.167873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171a73c-6b1b-4873-8649-f482d725e22b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.198802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 274/552] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:35:16.201250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.201541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.201812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.226636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:16.231418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:16.232417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:16.329399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171a73c-6b1b-4873-8649-f482d725e22b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:16.353255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 275/553] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:16.382790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:16.383386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.383663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.383932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.473809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:16.475449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:16.518147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.519377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:16.602160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 279/554] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 11:35:16.607714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.616566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:16.722707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75540b-a2c1-4149-92c3-2958ceddffea None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:16.749719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26cb68-d2c4-45ce-870b-62150ea553ed None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:16.753407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:16.754214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.754597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.755037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.767703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:16.772924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:16.774023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:16.774853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:16.775490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 276/555] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:16.776288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.791048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:16.791677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.791953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.792219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.794176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:16.803996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:16.805452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:16.821177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:16.823122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:16.824929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:16.824929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:16.824929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:16.828555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 280/556] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:16.828555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.885600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:16.892811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c845c8-dbed-4e2f-a25b-efc8bf8bda95 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:16.936444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:16.937247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.937622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.937996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.938448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff956ca-52b4-4fa2-a902-d1d33145315b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:16.953365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:16.958644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:16.960252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:16.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:16.966987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 277/557] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:16.968079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:16.984057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:16.984827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:16.985243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:16.985524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:16.986206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:16.986513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:16.988670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.004727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 281/558] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:17.004727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.072512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.087490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f21f6-9edf-45da-84b7-e9a63ab12581 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.129232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.129987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.130339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.130611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.131298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:17.131607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.133511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.138976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcebb9-df13-4f31-9be5-90ca9abbf07b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.152332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 278/559] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:17.152332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.171456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.186329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.187525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.187996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.188480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.189404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:17.189905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.191509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.205210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 282/560] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:17.206492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.278536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d4d6-0c3b-4915-b75e-6181ec64581f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.311326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6da94-38b4-4213-bb05-22441d3c9e71 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.321426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.322082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.322361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.322633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.323680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.336291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.338023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.350905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.351897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.352387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.352848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:17.356766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:17.357729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:17.358750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:17.358750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:17.358750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:17.362780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 279/561] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:17.363688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.363805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.365613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:17.379120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:17.380154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:17.381093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:17.383301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 283/562] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:17.384368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.440179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.479760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf527df-2718-4e18-9457-8cbfdd365a15 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.516033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b60a2-e27f-4cc0-8603-5543450ee705 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.517901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.518922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.519394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.519852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.532308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.534240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.555053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.555675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.555953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.556224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.556877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:17.557183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.560456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:17.561155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:17.562077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:17.562998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:17.562998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:17.562998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:17.564947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 280/563] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:17.570590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.571892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 284/564] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:17.575509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.615768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.687176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308576b-84e1-498f-9f52-bf3db07d90bc None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.691265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803eecb-ff74-4485-8a8f-59d5686fee47 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.707590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.727145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.727866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.728139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.728252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.728535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.728751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.729026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.729296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.729444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:17.729771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.729931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:17.730226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.731418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4a359-ed31-4fc0-affb-c6ecc14bd7f4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.731619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.746724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 285/565] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:17.747572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.750296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 281/566] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:17.752023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582c18-d6bd-4c05-a6f0-f0228a50cf0b None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.752313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582c18-d6bd-4c05-a6f0-f0228a50cf0b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.752584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582c18-d6bd-4c05-a6f0-f0228a50cf0b None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.754016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 282/567] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:17.758994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582c18-d6bd-4c05-a6f0-f0228a50cf0b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.853269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:17.863639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f7ffb-0637-409e-8b3e-bb3f2de9dd15 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.873998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582c18-d6bd-4c05-a6f0-f0228a50cf0b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:17.897882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.898514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.898813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.899077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.906633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.908164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.909479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:17.910119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.910397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.910677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.919044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:17.919579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:17.920498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:17.921427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:17.921986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:17.922068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 286/568] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:17.922068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-bc2f95ab-77e6-4aff-b62b-5da93a788e48 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:17.935392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:17.936509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 283/569] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0af54-cdb0-4051-bc2d-a4b4181cf35e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:17.942393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0af54-cdb0-4051-bc2d-a4b4181cf35e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:17.943257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0af54-cdb0-4051-bc2d-a4b4181cf35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:17.960781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-14d0af54-cdb0-4051-bc2d-a4b4181cf35e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:17.962008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-14d0af54-cdb0-4051-bc2d-a4b4181cf35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:17.995717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.023418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51160-0b9c-4e8e-a063-a818de8e5b5b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.028186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 284/570] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:18.029442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd6313-7eef-4e51-a686-98da105f093b None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.029722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd6313-7eef-4e51-a686-98da105f093b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.029986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd6313-7eef-4e51-a686-98da105f093b None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.031232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 285/571] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:18.031903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd6313-7eef-4e51-a686-98da105f093b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.071239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.071843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.072117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.072381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.073108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=bc527e0ec230497cb664de8ea319ba7a) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:18.073414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.074876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.082981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 287/572] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:17 2022] GET /identity/v3/role_assignments?user.id=bc527e0ec230497cb664de8ea319ba7a&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:18.084094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.103438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.180539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd6313-7eef-4e51-a686-98da105f093b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.201754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327726d-deac-43cd-aee3-a95f2440a106 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.236114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.236739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.237014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.237281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.238031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:18.238325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.240134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0bf57-06e9-4f9f-94f6-f4066420e01b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.251516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.252294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.252569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.252833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.254510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:18.254867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.256375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.265671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 286/573] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:18.268687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.269209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.269770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.277020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 288/574] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:18.278157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.293557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:18.295863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:18.323300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.358630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.374722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 287/575] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:18.374722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.402580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1cc16-1eca-41e6-963e-c4673d7a9117 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.441587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.442281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.442599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.442988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.454154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.455573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:18.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:18.473143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:18.474344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:18.474344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:18.474344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:18.478630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 289/576] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:18.479748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.504975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c4da-f7b0-4fac-83d0-7fa9472590f4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.548694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.549394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.549673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.549953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.563991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.565535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:18.586390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:18.587454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:18.593468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:18.593468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:18.593468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:18.593468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 288/577] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:18.593468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.603082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.609492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f48f-1de6-42b3-9d78-5fece7f0aa64 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.634883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.648012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.649105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.649588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.650170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.661155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:18.667540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:18.668464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:18.669309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:18.676339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 290/578] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:18.676339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.695599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de46b5-8d0e-4d7a-8ce1-6b3cbb7be78a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.734876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.735481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.735761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.736029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.736679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:18.736985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.741005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.752140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 289/579] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:18.753221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.790389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f490e-4430-4b96-b37c-57a8fa016f4a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.825638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.825847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.826407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.826711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.827074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.828151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:18.828698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:18.830217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:18.842090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 291/580] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:18.843738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.862590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a21e-8f4e-4595-87f7-4703bb56efde None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:18.896829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:18.901296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:18.901915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:18.902202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:18.902463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:18.913168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:18.918194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:18.919318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 290/581] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:18.920192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:18.964516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b67df0-0687-45d0-a2ea-e899dacbd1c4 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.000841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.001489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.001769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.002041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.002730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:19.003041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.004413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.017134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 292/582] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:19.017134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.037605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee41e-ca1d-4aa0-97d0-fcfcbc62f599 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.071092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.075402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.076344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.076973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.077246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.084843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.086400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:19.099888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:19.100940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 291/583] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:19.103657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.130463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd02c6-a8f6-4301-acc3-6193fab5fe21 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.138262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.167743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.168483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.168683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.168957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.177089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.178592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:19.191668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:19.192721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 293/584] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:19.193605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.219389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d7ca-0512-40bc-9652-95c56b90d699 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.257331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.258063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.258403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.258782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.259456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:19.259756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.261134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.271161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 292/585] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:19.271936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.325461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54dacd-5ec3-417c-b660-e794edd2c9bb None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.329632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.365163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.365845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.366088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.366359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.378558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.380066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.383508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c4809-1be3-49ab-a858-f814ee39f99c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:19.394452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:19.395888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:19.397635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:19.397635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:19.397635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:19.400561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 294/586] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:19.401081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.422564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.424914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.425727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.426102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.426988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.427295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:19.427782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.429333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.442326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 293/587] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:19.443346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.522704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79146af4-7798-4581-91de-cc13dfafbc8a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.554124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8fd70-ce93-4c8d-ae73-99db25ae4eab None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.560612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.561329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.561800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.562175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.563056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:19.563450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.565144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.568547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.578846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 295/588] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:19.579684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.609477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.610188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.610467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.610723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.622093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.623726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:19.640312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:19.641387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:19.642297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:19.642297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:19.642297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:19.642297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 294/589] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:19.642297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.680802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.705958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c1306-f253-423d-a676-a53c5f242052 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.743979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.745052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.745354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.745623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.746437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:19.746764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.748130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.757752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128264fd-56cb-43f8-bbe2-c49d69123eed None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.760774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 296/590] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:19.761318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.798585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.799415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.799755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.800088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/a782787a64c94d0f8a43f7f8deeb120b/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.815943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=a782787a64c94d0f8a43f7f8deeb120b, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.817405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.842721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 295/591] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:19 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/a782787a64c94d0f8a43f7f8deeb120b/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:19.842721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.870267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.874927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ebd9e-0642-4361-ab66-441de914991e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:19.917522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:19.918506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:19.919137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:19.919536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/8aaccbf6e1e746f5b7285d57564d9d5d/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:19.930864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:19.941215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=8aaccbf6e1e746f5b7285d57564d9d5d, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:19.943877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:19.970773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 297/592] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:19 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/8aaccbf6e1e746f5b7285d57564d9d5d/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:19.970773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:19.988732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae1b2e-0cef-489c-bc21-24770de49db1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.041794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.042433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.042752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.043029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.043700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:20.044000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.045538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78dfc-0b92-4d99-b34a-fcfd06b6b5b5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.059678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 296/593] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:20.061233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8bce-2e63-41b0-bba7-5fb1593ab6c1 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.061498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8bce-2e63-41b0-bba7-5fb1593ab6c1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.061772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8bce-2e63-41b0-bba7-5fb1593ab6c1 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.063456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 297/594] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:20.069317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.069622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.069866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.090726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:20.090726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:20.116334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e162e8a-c7fc-4775-909f-69826e53d9f9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.158840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.159846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.160404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.160676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.169925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.171392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.171815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 298/595] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:20.172680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.181010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:20.185865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:20.186922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:35:20.187874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:20.190956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 298/596] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:20.194914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.259006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:20.339342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60496930-c4a8-49fb-9198-74e89febf883 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.369530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa13a2-a49b-47a9-87ef-10f01349a5cd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.387068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.387766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.388049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.388318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.396415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.397901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:20.410338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:20.411465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:20.412438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 299/597] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:20.417325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.455155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.458160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.458528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.458833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.460486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:20.460928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.464460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.508779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 299/598] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:20.516015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.531584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:20.573422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28418d-e176-466b-83d7-7553438ac95d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.610574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.611277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.611555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.611824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.612662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:20.612974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.614505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.622540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9fc9b-82b0-45d0-bfa7-4a7b408de1ab None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.633474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 300/599] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:20.634393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.647066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:20.664235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.665839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.666504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.667389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.682581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:20.696834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:20.697881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:20.698774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:20.702813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 300/600] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:20.702813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.765534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2957-5ca8-4570-8f01-b4e4f474185f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.795102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:20.810397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.811470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.812182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.812564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.817165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d3637-e75e-4f57-b91b-17bbc013641f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:20.825888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.827551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:20.847717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:20.848963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:20.849887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:20.849887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:20.849887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:20.850881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 301/601] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:20.851867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.863174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:20.864229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:20.864847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:20.865378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:20.876939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:20.878744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:20.895493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:20.896596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:20.897497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:20.897497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:20.897497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:20.899821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 301/602] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:20.900946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:20.923308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:20.977204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14c12-2abc-4a32-8839-85fc43bde40c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.017178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6eaca-e43e-4d17-a154-585b5202e290 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.024245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.024873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.025154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.025425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.026101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:21.026408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.027993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.042370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 302/603] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:21.043453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.061498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.062856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.063546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.064025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.065070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:21.065596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.067438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.081642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.083678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 302/604] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:21.084859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.175745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea985-1f9e-4a72-ade1-9b0d4d3d8b5a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.187442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.215599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796335-061c-4ad6-b701-16d43bf56481 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.223372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.224740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.225257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.225759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.226986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:21.227553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.229729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.246322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 303/605] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:21.247701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.255005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.255773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.256122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.256469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.269377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.272400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:21.292418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:21.293472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:21.294673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:21.294673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:21.294673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:21.298782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 303/606] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:21.301748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.362092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.370055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0155-eedf-43a3-b864-7822347c8d46 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.409917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.411643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.412173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.412706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.423068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.425284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.439579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d010d2-1d4a-427e-9676-148ee9353caa None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:21.442878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:21.443766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:21.444743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:21.450645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 304/607] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:21.450645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.482326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.494147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.495253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.496323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.496798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.507238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.509064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:21.526414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:21.527411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:21.528294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:21.531539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 304/608] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:21.532590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.566481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0edb-ecfa-4cb7-81ec-d06bcbefd066 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.605524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.606409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.607082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.607557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.608813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:21.609508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.611741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.633138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 305/609] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:21.633138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.657633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.660616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd826-b8d0-4404-9fb0-17732a272909 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.696659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.697305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.697639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.697912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.698662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:21.698999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.700450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.718833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 305/610] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:21.719237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.755869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f781-8a95-45f1-8281-14c87b3477e6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.772481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.795856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.797225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.797697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.798157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.799094 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:21.799695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.801348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.815040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 306/611] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:21.816159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.827118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb07c0-49df-449f-a8a3-ce4dd17c5644 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.863766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.864491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.865043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.865153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.872946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.874428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:21.887553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:21.888547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:21.889488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:21.893530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 306/612] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:21.894636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:21.906957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:21.933381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f5e6e-2048-487d-9d78-1764b84f9130 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:21.973152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a18436-90fb-4e08-908b-aa1d1d24c745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:21.973863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a18436-90fb-4e08-908b-aa1d1d24c745 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:21.974131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a18436-90fb-4e08-908b-aa1d1d24c745 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:21.974412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a18436-90fb-4e08-908b-aa1d1d24c745 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/76c4d2542f6145c38255de0387094e1e/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:21.991545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a18436-90fb-4e08-908b-aa1d1d24c745 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=76c4d2542f6145c38255de0387094e1e, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:21.993022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a18436-90fb-4e08-908b-aa1d1d24c745 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:22.000630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb3b00-86f2-47ed-a284-4ddf7d39c227 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:22.008218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 307/613] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:21 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/76c4d2542f6145c38255de0387094e1e/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:22.009959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417ff7-4126-4851-ba50-3fbce7c5de3b None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.010247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417ff7-4126-4851-ba50-3fbce7c5de3b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.010521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417ff7-4126-4851-ba50-3fbce7c5de3b None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.011862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 308/614] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:22.012586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2417ff7-4126-4851-ba50-3fbce7c5de3b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.021304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:22.054370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fedb6d-caea-4829-91fe-576d43d6ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:22.055697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fedb6d-caea-4829-91fe-576d43d6ebfb None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.055697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fedb6d-caea-4829-91fe-576d43d6ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.055697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fedb6d-caea-4829-91fe-576d43d6ebfb None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/ac866c0c1c33423b9ecbf97a3b08240c/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.076430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fedb6d-caea-4829-91fe-576d43d6ebfb None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=ac866c0c1c33423b9ecbf97a3b08240c, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:22.077969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fedb6d-caea-4829-91fe-576d43d6ebfb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:22.093672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 307/615] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:21 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/ac866c0c1c33423b9ecbf97a3b08240c/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:22.095756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f7ecc-5a4f-49c5-b9ea-99f6199159fb None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.096254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f7ecc-5a4f-49c5-b9ea-99f6199159fb None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.096723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f7ecc-5a4f-49c5-b9ea-99f6199159fb None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.098330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 308/616] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:22.100172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926c3f-d099-42e9-b370-991eef296c49 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.100700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926c3f-d099-42e9-b370-991eef296c49 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.101170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926c3f-d099-42e9-b370-991eef296c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.122101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-68926c3f-d099-42e9-b370-991eef296c49 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:22.123836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-68926c3f-d099-42e9-b370-991eef296c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:22.155957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2417ff7-4126-4851-ba50-3fbce7c5de3b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:22.193665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:22.206290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:22.207064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.207411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.207742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.208638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:22.209009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:22.210493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:22.219358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 309/617] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:22.221486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.221772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.222040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.245032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:22.246282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:22.249144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 309/618] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:22.259906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.349151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 310/619] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:22.412530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a231-2c3d-490c-8784-cae8bcd6c0cf None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:22.450081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:22.450754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.451036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.451309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.463068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:22.464567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:22.481214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:22.482323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:22.483447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:22.483447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:22.483447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:22.486061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 310/620] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:22.488759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.522587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:22.615159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.630742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c33e6-cbaa-4f33-a6fe-e7fa69a5f68f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:22.704297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:22.704932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.705212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.705484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.706206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:22.706511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:22.707981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:22.714534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:22.740070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 311/621] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:22.746512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.786970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ca6a2-52a5-4dc6-af37-e340152fe80b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:22.832051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:22.832759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.832956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.833287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.847736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:22.848714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:22.855827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:22.856980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:22.857877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 311/622] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:22.858597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.876005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11020b25-df91-4dae-957c-b92ec3941f2f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:22.916959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:22.918024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:22.918524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:22.919003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:22.926700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:22.928277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:22.941328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:22.942283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:22.943301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 312/623] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:22.944516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:22.980275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:22.989133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c21c3-5623-4867-9b66-cdf92a6c10a9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.040822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.042335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.042879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.043615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.054649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b87c81-81c3-4ff8-9d81-13d96f9e49f4 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.059289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:23.066260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:23.067302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:23.068315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:23.070526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 312/624] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:23.071812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.096971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.097788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.098240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.098520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.099759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:23.100027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.101608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.112459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 313/625] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:23.113449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.116913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:23.214877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be5b2-223a-4d56-84e3-452b5adba196 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.227803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7d3a-cbf2-4a28-a922-5ac2c4ea9b2a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.256280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.257035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.257411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.257781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.258580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:23.259027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.260605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.273048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.273992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.274439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.274556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 313/626] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:23.274990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.275667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.276035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:23.276577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.278137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.291417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 314/627] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:23.292746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.297865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:23.384283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:23.391197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63b5f-fe62-465f-ba17-4e6fc7c5f0bc None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.436864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c2476-c32f-4d9c-82df-4ca46e94c528 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.438270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.439354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.440704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.441157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.455988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.457665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.473820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.474641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.475040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.475405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/bc527e0ec230497cb664de8ea319ba7a/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:23.478927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:23.480248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:23.481490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:23.481490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:23.481490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:23.484339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 314/628] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:23.485323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.496470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=bc527e0ec230497cb664de8ea319ba7a, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.498136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.515445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 315/629] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:23 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/bc527e0ec230497cb664de8ea319ba7a/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:23.516639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.568740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:23.609604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359bec-a237-480b-abd2-f6a52a75b47b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.647897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.648815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.649332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.649745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.653876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76293-aa1a-4bb6-b5bd-252f12437968 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.662836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.664983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.671739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:23.684716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:23.685748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:23.686647 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:23.686647 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:23.686647 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:23.689034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 315/630] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:23.695570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.697212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.697841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.698118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.698386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.699105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:23.699409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.701012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.716847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 316/631] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:23.722508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:23.843272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08421e-55db-48a5-9236-7729c3a20313 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.887057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:23.918566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:23.919212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:23.919490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:23.919758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:23.920413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:23.920716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:23.922114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:23.929725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06aba3-f351-4512-96f3-7625a91ab779 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:23.935304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 316/632] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:23.940638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.005443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:24.006116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.006396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.006669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.023337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:24.024818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:24.048325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:24.049378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:24.050330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:24.050904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 317/633] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:24.055387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.100054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7989-f502-48c4-8674-7b4e7fc75e9f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:24.126013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:24.144136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:24.144902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.145176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.145558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.162335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:24.163857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:24.186470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:24.187534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 11:35:24.188461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:24.191091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 317/634] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:24.199812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.209492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538bef5-56a7-4fd6-a134-bb6fac8f97f9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:24.255360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:24.273011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:24.273645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.273929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.274204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.275003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:24.275399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:24.276977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b4b6-29dc-4ac9-b5f2-ab8fa22ff907 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:24.313477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 318/635] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:35:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:24.315069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfee88-3028-440f-9fa4-8c893d3b93c8 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.315361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfee88-3028-440f-9fa4-8c893d3b93c8 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.315640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfee88-3028-440f-9fa4-8c893d3b93c8 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.320603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4734-367b-45c8-8810-4c089cd78117 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:24.321504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 319/636] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:24.322475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfee88-3028-440f-9fa4-8c893d3b93c8 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.359761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:24.360443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.360717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.361665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.361872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:24.362054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:24.363495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f7cf-668e-4e18-b569-02c43b00f7dd None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:24.382230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 318/637] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 6 11:35:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:24.383515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c913f5-7dfc-44fe-a418-e1c0109b8e97 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.383897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c913f5-7dfc-44fe-a418-e1c0109b8e97 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.384175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c913f5-7dfc-44fe-a418-e1c0109b8e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.402833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b4c913f5-7dfc-44fe-a418-e1c0109b8e97 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:24.404056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b4c913f5-7dfc-44fe-a418-e1c0109b8e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:24.433289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:24.444005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfee88-3028-440f-9fa4-8c893d3b93c8 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:24.480715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a9719-8e89-4204-8562-28b1b84fdd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:24.481328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a9719-8e89-4204-8562-28b1b84fdd27 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.481603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a9719-8e89-4204-8562-28b1b84fdd27 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.481872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a9719-8e89-4204-8562-28b1b84fdd27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.487648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 319/638] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:24.489077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801705b-6f0d-46cc-9e0d-9b92f5a206e5 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.489569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801705b-6f0d-46cc-9e0d-9b92f5a206e5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.490012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801705b-6f0d-46cc-9e0d-9b92f5a206e5 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.491467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 320/639] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:24.492292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801705b-6f0d-46cc-9e0d-9b92f5a206e5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.526780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:24.574964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a9719-8e89-4204-8562-28b1b84fdd27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:24.576498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a9719-8e89-4204-8562-28b1b84fdd27 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:24.617046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801705b-6f0d-46cc-9e0d-9b92f5a206e5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:24.661282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:24.662025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.662306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.662576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.681649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:24.694215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 320/640] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:24.696586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:24.697063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:24.697515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:24.721838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:24.723525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:24.754764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:24.756583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:24.787944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:24.814712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 321/641] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:24.814712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.896664 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 321/642] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:24.906746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:24.950715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9bbf-95f2-42c7-ba7b-73a5a4ae83d1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:24.985042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.012024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.012690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.013963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.013963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.027655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.029133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:25.045668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.046677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:25.047623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:25.047623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:25.047623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:25.053229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 322/643] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.054207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.124927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4b7d-3486-4093-bcc7-09f4381b92ad None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.163936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b9783-6b61-4e03-8631-94e9cfddf5ff None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.168926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.183384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.184113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.184389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.184657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.196204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:25.200505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.201154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:25.201261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.202206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:25.203113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:25.203762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.203762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.203902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 322/644] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.203902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.226246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.228204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:25.253032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.254088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:25.255369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:25.255369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:25.255369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:25.259109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 323/645] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.260028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.295040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.339891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e2e34-59bc-4e62-aefa-6730f43c6638 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.379262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.379882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.380230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.380504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.381157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:25.381455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.383644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.400923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 323/646] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:25.400923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.403465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5916a9-628d-4980-b609-e35b7e9904f5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.440663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.441219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.441493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.441767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.452235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:25.457499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:25.457659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.458707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 324/647] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.459574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.528100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ae46b-485d-433f-bdc4-48ab531e424f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.554730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.571537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09435f3-c6cd-4e9a-bca9-3dd3aa947de2 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.573571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.574574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.575188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.575749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.577109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:25.577729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.579724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.591241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 324/648] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:25.593126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.606881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.607497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.607776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.608047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.608696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:25.608997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.610374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.622228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 325/649] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:25.623061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.715795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4edc7-d9f5-44f8-afc2-f6a0ad01d095 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.723650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daaf7c-dcb6-448c-974a-c4e01634a1ea None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.728929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.757515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.758343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.758453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.758803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.759081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.759227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.759364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.759630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.760294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:25.760594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.761974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.768191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.769849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 326/650] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:25.770122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.770733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.783109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f332fac2-9f9d-4e43-839e-1e24f5217d2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:25.789669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.790567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:25.791510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 325/651] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.793267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fc43-e81e-4ea4-a06e-04249b4ed738 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.793690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fc43-e81e-4ea4-a06e-04249b4ed738 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.794104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fc43-e81e-4ea4-a06e-04249b4ed738 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.796258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 326/652] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:25.797186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fc43-e81e-4ea4-a06e-04249b4ed738 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.877010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430c144-9de6-4873-be10-61ab8d476f13 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.911009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.911649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.911926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.912197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.917910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fc43-e81e-4ea4-a06e-04249b4ed738 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:25.922837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.924307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:25.938723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.939745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:25.941154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:25.941154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:25.941154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:25.941154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 327/653] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.941154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:25.962161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:25.962999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:25.963427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:25.963854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:25.973067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:25.974980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:25.990763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:25.991665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:25.992569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 327/654] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:25.993581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.004124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.031121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.045998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d92e2-e45d-4520-acac-b91684261354 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.078383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.079045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.079323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.079591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.090105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.091616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9d581594-062b-407c-844d-cffd6a2e654b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:26.108020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:26.109098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:26.109986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:26.109986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:26.109986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:26.109986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 328/655] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:26.110544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.110659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.110923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.118164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831193e5-1b4f-43b8-8a18-13cd40c61a9c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.128953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:26.130265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:26.155824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.156444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.156726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.156996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.157693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:26.158026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.159490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.171680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 328/656] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:26.172329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.203083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 329/657] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:26.203980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.248454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.283177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.294937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12fcda-1ece-48d1-8b66-aa82d6363b16 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.311477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75fe70-f291-4f50-80ea-b1fa67519611 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.331146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.331760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.332033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.332302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.332937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:26.333266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.334646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.346575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 329/658] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:26.347408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.352951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.353578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.353859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.354127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.354859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:26.355168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.357078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.370342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 330/659] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:26.371201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.462837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f00a5-3e6e-4354-b4d8-8ddc54d1d533 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.496799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062fceb-5ecf-4ee5-bd0b-fdf3a5965dc5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.498315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.498960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.499556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.500021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.500218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.500785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:26.501133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.502489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.519565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 330/660] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:26.519565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.529332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.533486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.534107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.534381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.534640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.535399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=a782787a64c94d0f8a43f7f8deeb120b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:26.535723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.537310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.543640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 331/661] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/role_assignments?user.id=a782787a64c94d0f8a43f7f8deeb120b&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:26.544482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.645988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65964-90a7-4fbc-9d84-8b7a6ab1ec97 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.655687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812ee6-f035-40b4-a922-7d7ef868a525 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.686352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bde91-5404-442d-b587-052f28671494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.686590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bde91-5404-442d-b587-052f28671494 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.686891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bde91-5404-442d-b587-052f28671494 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.687161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bde91-5404-442d-b587-052f28671494 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.692600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.696067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bde91-5404-442d-b587-052f28671494 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.697308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.697583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.698245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.698583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=8aaccbf6e1e746f5b7285d57564d9d5d) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:26.698915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.700370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.704821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bde91-5404-442d-b587-052f28671494 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.714725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 332/662] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/role_assignments?user.id=8aaccbf6e1e746f5b7285d57564d9d5d&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:26.714725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-628bde91-5404-442d-b587-052f28671494 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:26.718225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:26.719304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 11:35:26.720653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:26.725039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 331/663] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:26.726154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bde91-5404-442d-b587-052f28671494 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.764244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.827685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:26.863190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c482-dddc-4adf-8f4c-2a3ee52eb8e0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.874453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bde91-5404-442d-b587-052f28671494 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:26.913115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.913785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.914065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.914335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.916074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:26.916707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:26.916980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:26.917261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:26.925802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:26.926425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:26.927365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:26.931868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:26.932809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:26.933664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 333/664] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:26.934396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:26.945849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:26.946929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:26.947882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 332/665] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:26.948486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.051265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.063327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9af0-20cb-4cb6-84ed-d267c8cb5df7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.075066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa8af1-778e-4462-ac47-b62a702b05d8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.108950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.110079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.110539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.110900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.111829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.112558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:27.112894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.115270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.120128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.120872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.121268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.121638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.122408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:27.122980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.124758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.136375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 333/666] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:27.136682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 334/667] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Sep 6 11:35:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:27.137460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.141858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.244282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29154b-2b56-4701-80a6-40ea9795d8e3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.244969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5832990-a27b-4665-adb5-8fc81f2fdb96 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.279319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.279938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.280208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.280473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.281033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.281243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:27.281493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.282294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.282800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.282975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.283446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.294971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.296768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.301340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 334/668] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:27.302039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:27.313952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:27.314990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:27.315918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:27.315918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:27.315918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:27.318582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 335/669] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:27.318722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.319903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.365972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.420062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766303-c79b-4bf7-956f-a43505cb4e84 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.453880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb98a-47f2-4e1e-a4d0-5debf4d60838 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.470888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.472188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.472700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.473171 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.489082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.489754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.490025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.490290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.557691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.558798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.559751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.561934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.563615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.613203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.668194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 335/671] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:27.669493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.671751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 336/671] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:27.672756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.786470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92ecd0-be34-472a-aa0b-564ab9ce7705 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.790601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.794496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e541cf-4fa4-4bf8-b819-a28cbcca812f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.824145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.825101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.825602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.826072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.827026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:27.827695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.829409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.830807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.831489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.831766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.832034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:27.842958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:27.843610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 336/672] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:27.844331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:27.844894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.858850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:27.867093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:27.868180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:27.869125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:27.869125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:27.869125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:27.873312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 337/673] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:27.874388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:27.955876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d857ae-a906-4292-b430-51a25028497f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.985533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6c5b-3586-45ba-b401-00db70dd4e86 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:27.994234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:27.995189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:27.995671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:27.996166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.008449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.010254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.021826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.022463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.022762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.023030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:28.027139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:28.028059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:28.028955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:28.028955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:28.028955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:28.031043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 337/674] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:28.031190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.032205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.032761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:28.046304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:28.047377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:28.048318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:28.052352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 338/675] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:28.053324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.070861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.104918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.146453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ca69-0480-417a-b43e-3b5f831342f8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.169409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29c1c8-3427-4e13-8acb-967b7f80f4b0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.181654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.182406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.182866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.183248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.184002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:28.184426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.185906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.203086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 338/676] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:28.203086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.212932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.213886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.214343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.214809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.215649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:28.216206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.217929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.232543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 339/677] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:28.233825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.310402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c958e-f015-42ea-b37e-898606a89a14 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.314555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.334704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.348439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.349279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.349560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.349833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.350928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:28.351239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.352980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.353962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fee30-8171-405c-96c0-34feae2d7ea1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.379846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 339/678] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:28.379846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.397443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.398597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.399217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.399694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.407955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.410074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:28.430534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:28.431585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:28.432614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 340/679] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:28.433741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.498017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a32f9-5991-4cf9-b52c-dacc478e759e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.545729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.546759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.547054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.547329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.557377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.559680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.565095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9a56-3fd6-4bc5-9c68-e31c75672de0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:28.571862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:28.572791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:28.573767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 340/680] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:28.574295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.602173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.609375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c62e-3ebb-4255-880f-a82ebc7e46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.609894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c62e-3ebb-4255-880f-a82ebc7e46c7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.610176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c62e-3ebb-4255-880f-a82ebc7e46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.610452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c62e-3ebb-4255-880f-a82ebc7e46c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.621688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.684006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7c62e-3ebb-4255-880f-a82ebc7e46c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.685463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7c62e-3ebb-4255-880f-a82ebc7e46c7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.686266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01ad1a-9c83-46b5-8106-5557d9762bca None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.723301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.723966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.724246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.724523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.725227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:28.725532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.727005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.741356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 341/681] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:28.741356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.803512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 341/682] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:28.803512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c821-e304-4896-9aca-63a2cef5cd27 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.803512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c821-e304-4896-9aca-63a2cef5cd27 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.803512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c821-e304-4896-9aca-63a2cef5cd27 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.806272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 342/683] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:28.807108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c821-e304-4896-9aca-63a2cef5cd27 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.837225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.847940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:28.851437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f779f-688f-47dd-b327-97c46c7fd08b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.885030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.885630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.885898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.886162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.886878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:28.887212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.888643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.900988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 342/684] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:28.901656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:28.908403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c821-e304-4896-9aca-63a2cef5cd27 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:28.941132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:28.941667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.941941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.942208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.942991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=76c4d2542f6145c38255de0387094e1e) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:28.943294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:28.944735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462637ad-b72a-4e3c-82ef-fe97c612e78f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:28.954885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 343/685] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/role_assignments?user.id=76c4d2542f6145c38255de0387094e1e&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:28.954885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36861f6-08bb-4055-9dab-04b1d4b5ee1d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:28.954885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36861f6-08bb-4055-9dab-04b1d4b5ee1d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:28.954885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36861f6-08bb-4055-9dab-04b1d4b5ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:28.981746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b36861f6-08bb-4055-9dab-04b1d4b5ee1d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:28.983106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b36861f6-08bb-4055-9dab-04b1d4b5ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:29.019283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f8b9-c86d-4bc8-8f46-d650668d39e6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.070196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 344/686] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:29.070196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a1dde-2b74-43fd-971d-a274fc8ce15e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.070196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a1dde-2b74-43fd-971d-a274fc8ce15e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.070196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a1dde-2b74-43fd-971d-a274fc8ce15e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.070196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 345/687] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:29.070196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a1dde-2b74-43fd-971d-a274fc8ce15e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.072713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.073696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.074102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.074379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.088911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.090390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-084456a3-82d5-49d7-a72e-8f617c2b4a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:29.107899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:29.108973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:29.109916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:29.109916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:29.109916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:29.110105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:29.110355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 343/688] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:29.114837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.114837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.114837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.137093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:29.137093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:29.145962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:29.224167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a1dde-2b74-43fd-971d-a274fc8ce15e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.226912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 344/689] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:29.233646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.284452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.285078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.285352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.285620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.286431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=ac866c0c1c33423b9ecbf97a3b08240c) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:29.286770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.288233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.307480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 346/690] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/role_assignments?user.id=ac866c0c1c33423b9ecbf97a3b08240c&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:29.348034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.419036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b551dcb-3785-423b-bd00-52930a0b6896 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.485680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.486281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.490735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.490735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.490735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:29.490735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.490735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.505445 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 345/691] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:29.511808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.515274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:29.517345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:29.531237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e0d2-0892-40aa-8b47-4ca554472e52 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.571338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.571965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.572244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.572515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.587057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:29.593323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:29.594486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:29.595904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 347/692] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:29.596800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.650090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008715d-9ee3-4b76-9eda-6c6ca43b1d2d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.693727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.694911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.695434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.695980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.705016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.705953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899a0b-4485-4795-bff6-588085079f1f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.706870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:29.730116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:29.731256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:29.732358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:29.735102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 346/693] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:29.736189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.748381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.749172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.749545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.749912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.763715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.765867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:29.785402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:29.786640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:29.787825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:29.787825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:29.787825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:29.789171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 348/694] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:29.790122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.793996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:29.824907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:29.867493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e6da3-3019-4314-96df-8e1e46063b91 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.910324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.911612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.911990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.912594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.913771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:29.914176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.916929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf246c-bc7d-42a9-b5ac-98da88b81fc7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:29.919327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.928719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 347/695] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:29.929567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:29.963532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:29.964149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:29.964990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:29.965275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:29.966043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:29.966351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:29.968252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:29.991999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 349/696] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:29.991999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.068294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:30.076228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f752b5-4b10-4895-bc08-6ab9a6a56ce1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.103388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:30.115278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.115935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.116216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.116488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.117137 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:30.117443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.118870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.129660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01922-82d1-485c-b3f5-c0d3fd3748ce None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.137637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 348/697] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:30.138719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.174662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.175833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.176269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.177637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.190722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.193200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:30.213057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:30.214246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:30.215298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:30.215298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:30.215298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:30.218141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 350/698] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:30.219154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.253251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9159ff-11b5-48d1-a755-ddf8a98977b7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.298426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.299534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.299972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.300833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.302041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=bc527e0ec230497cb664de8ea319ba7a) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:30.302498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.305065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.312365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 349/699] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:30 2022] GET /identity/v3/role_assignments?user.id=bc527e0ec230497cb664de8ea319ba7a&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:30.313805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.336500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3289cb-fcb3-4243-8d24-4352353684ee None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.352409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:30.375933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.376754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.376997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.377343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.378151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.379626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.380182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:30.407338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 351/700] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:35:30 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:30.486064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc6d03-4522-4da3-b64d-d10632213227 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.537158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.538109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.538584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.539075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.539934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:30.540419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.542002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.556549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 350/701] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:30.562034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.681337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06925-5fa8-4aa8-bdae-74933419c64c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.717887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.718531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.719210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.719210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.728518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.730018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:30.742760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:30.743775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:30.745429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 352/702] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:35:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:30.749790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.860730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b418-db54-43fd-8fb7-97033aa85c79 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:30.871203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:30.899073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:30.899626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:30.899906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:30.900215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:30.900927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:30.901244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:30.902841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:30.921353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 351/703] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:35:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:30.927020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:30.974430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:31.076024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b111-a37c-4946-80dc-70ce0b20737f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:31.115094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c65bd4-1580-4dc1-bada-738b22543db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:31.115629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65bd4-1580-4dc1-bada-738b22543db8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.115908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65bd4-1580-4dc1-bada-738b22543db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.116179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65bd4-1580-4dc1-bada-738b22543db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.193201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c65bd4-1580-4dc1-bada-738b22543db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:31.194715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c65bd4-1580-4dc1-bada-738b22543db8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:31.231055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:31.302449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 353/704] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:31.308021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:31.423565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c2a8-cec3-46db-a017-3b9be49021ab None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:31.458561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:31.459227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.459502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.459768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.470785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:31.472255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-53f6c97f-d53d-4d65-99ed-8e59519f42fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:31.487474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:31.488482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:31.489409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:31.489409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:31.489409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:31.489591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07154d3-88f4-432f-a45b-7490e710a022 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.489591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07154d3-88f4-432f-a45b-7490e710a022 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.489591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07154d3-88f4-432f-a45b-7490e710a022 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.490123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 352/705] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:31.490203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 354/706] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:31.495415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d472b9-fb69-48d1-856e-d523583663ae None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.495703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d472b9-fb69-48d1-856e-d523583663ae None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.495980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d472b9-fb69-48d1-856e-d523583663ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.499677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07154d3-88f4-432f-a45b-7490e710a022 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:31.514869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-14d472b9-fb69-48d1-856e-d523583663ae None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:31.516086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-14d472b9-fb69-48d1-856e-d523583663ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:31.531299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:31.590802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 353/707] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:31.685676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214f50-2e76-4b73-87f9-8332a61518c2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.686295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214f50-2e76-4b73-87f9-8332a61518c2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.686823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214f50-2e76-4b73-87f9-8332a61518c2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.688765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 354/708] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:35:31.693936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.694480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.695023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.704344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07154d3-88f4-432f-a45b-7490e710a022 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:31.715404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:31.716833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:31.745205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:31.765368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:31.766363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.766868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.767335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:31.768240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:31.768738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:31.770326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:31.795450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 355/709] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:31.804639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:31.833000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 355/710] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:31.884009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:31.933844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6735-cf66-4353-a232-7e933d1d60f5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:31.965265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:31.988354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb24e-2c81-44e3-8a38-6e443aef6b78 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:31.995393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:31.996401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:31.996924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:31.997458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.012032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.014042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.031568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.032242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.032521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.032793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.033467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:32.034238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:32.035215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:32.036206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:32.036705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.039033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 356/711] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:32.045279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:32.063110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:32.064323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:32.065204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:32.071122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 356/712] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Sep 6 11:35:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:32.074284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.124847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:32.192235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0e298-a9b4-45e4-9503-59a7c4fc8da7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.217472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee7e3f-1dff-4edc-b53c-e12ceb62c987 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.238730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.239428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.239709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.239980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.240693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:32.241000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.242594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.257173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.258237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.258738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.259221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.260061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:32.260557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.261314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 357/713] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:32.262198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.262735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.268180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 357/714] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:32.269261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.279183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:32.374623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1880a-c43d-4f39-ad39-e52298552479 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.376160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434e83-78cd-46fe-8ebd-890b3850af48 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.387284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:32.413669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.414491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.414805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.415079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] PATH_INFO: `/v3/services/network` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.415678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.416479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.417092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.417546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.418014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.418485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.419557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=a782787a64c94d0f8a43f7f8deeb120b) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:32.420083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.421826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.428641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 358/715] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/role_assignments?user.id=a782787a64c94d0f8a43f7f8deeb120b&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:32.428778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:32.429709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:32.430557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:32.432718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.436117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 358/716] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:32.441950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.511814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:32.576874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d9e70-f153-40ec-b255-cc7a26b86e1f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.655831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.656454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.656728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.656997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.657633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:32.657933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.659346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.661243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a28d-928f-4ddb-bb9c-da4999b3b432 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.666477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 359/717] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:32.702178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.703299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.703784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.704276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.705155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] RBAC: Adding query filter params (name=network) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:32.705662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.707326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e0ae0-3765-491d-9621-9e05631fb541 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.721284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 359/718] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:32.722225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:32.863193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368488e-7b49-415f-8783-d4aad0da6f38 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:32.909579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:32.910213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.910488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.910831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.911623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:32.911936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:32.913333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9665e-a987-4906-a2c6-2c2c92b38ca5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:32.914748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:32.920082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 360/719] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:32.993497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c05d-fe2c-42f7-9b0b-1ff65e4120db None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:32.993842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c05d-fe2c-42f7-9b0b-1ff65e4120db None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:32.994050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c05d-fe2c-42f7-9b0b-1ff65e4120db None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:32.995740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 360/720] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:33.002530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af889e5-9baa-4297-9cd1-1038746d8035 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:33.002953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af889e5-9baa-4297-9cd1-1038746d8035 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:33.003136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af889e5-9baa-4297-9cd1-1038746d8035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:33.024379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6af889e5-9baa-4297-9cd1-1038746d8035 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:33.025623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6af889e5-9baa-4297-9cd1-1038746d8035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:33.109263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 361/721] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:33.171990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c2b31-f472-479f-8970-c9fed7f75428 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:33.172340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c2b31-f472-479f-8970-c9fed7f75428 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:33.172543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c2b31-f472-479f-8970-c9fed7f75428 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:33.174181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 361/722] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:33.180065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:33.180616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:33.181103 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:33.212660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:33.214208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:33.301815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 362/723] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:35:33.468423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c2b31-f472-479f-8970-c9fed7f75428 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:33.520770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:33.604363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c2b31-f472-479f-8970-c9fed7f75428 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:33.646857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:33.647974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:33.648623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:33.648896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:33.649162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:33.670489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:33.675824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:33.676762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:33.677649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:33.678303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 362/724] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:33.685813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:33.760530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:33.837125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabf3ae-1612-4fe7-9d70-3ca33d074a43 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:33.863371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:33.868671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728a4f-8b2f-4611-894e-8da616341db9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:33.896594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:33.897248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:33.897526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:33.897794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:33.922528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:33.931282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:33.932219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:33.933054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:33.933688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 363/725] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:33.939304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:33.943939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:33.944572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:33.944851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:33.945122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:33.945804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:33.946106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:33.947520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:33.966524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 363/726] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:33.986946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.091614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19036e5-fdd8-451d-ba64-e37760699a6f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.131067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:34.142228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5b5b1-c1e3-4c78-9a9a-788f1ca15263 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.171426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.172052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.172343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.172626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.173313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:34.173621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.175195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.180015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.180928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.181405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.181861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.192382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 364/727] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:34.193455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.195171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.198055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:34.211171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:34.212193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:34.213082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:34.213082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:34.213082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:34.215203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 364/728] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:34.221279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.254713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:34.312192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42664df2-ef24-4e45-9af0-42f88e705248 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.354923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.354923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.354923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.354923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.374059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.375551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:34.401021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:34.402035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:34.402963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:34.402963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:34.402963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:34.402963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 365/729] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:34.408328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.420694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d402d-f238-4ff3-bb8c-0622dab3a288 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.442676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:34.487222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.487854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.488134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.488403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.489059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:34.489411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.490910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.516253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 365/730] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:34.516967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d427-98d4-4c58-89bc-6c701da4459b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.522169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.554595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.555273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.555553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.555860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.556618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:34.556930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.567004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.572635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 366/731] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:34.578403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.659183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:34.688749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:34.692729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7b99-e9e8-4f49-9b34-1e2a12991a78 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.698081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3119db-6a9a-4729-a17f-1efc925e03fb None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.733638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.734585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.735058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.735523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.738264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.741607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.741607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.741607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.747721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.748520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.749143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.750839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-81b68aed-897c-4929-9fba-b27a0c44011d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:34.764012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:34.765158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:34.766126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:34.773601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 366/732] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:34.775603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4a4e-2bdc-4537-9307-86a3f4173ee0 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.776177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4a4e-2bdc-4537-9307-86a3f4173ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.776624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4a4e-2bdc-4537-9307-86a3f4173ee0 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.778553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 367/733] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:34.779597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4a4e-2bdc-4537-9307-86a3f4173ee0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-35e06d2e-49de-472f-98ab-fbcb21bee0af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:34.884951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:34.886012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:34.887009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:34.889311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 367/734] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:34.890847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87eae-351d-4f42-945d-68b550f8efb4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.891289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87eae-351d-4f42-945d-68b550f8efb4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.891724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87eae-351d-4f42-945d-68b550f8efb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.913028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-34e87eae-351d-4f42-945d-68b550f8efb4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:34.914571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-34e87eae-351d-4f42-945d-68b550f8efb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:34.914969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4a4e-2bdc-4537-9307-86a3f4173ee0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:34.955173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:34.961137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:34.961770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.962050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.962325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.963225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:34.963538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:34.965222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:34.984399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 368/735] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:34.985284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:34.993731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 368/736] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:34.995406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2247a-0512-44f8-8eb7-57dd7620d2ee None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:34.995755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2247a-0512-44f8-8eb7-57dd7620d2ee None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:34.996090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2247a-0512-44f8-8eb7-57dd7620d2ee None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:34.997507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 369/737] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:34.998183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2247a-0512-44f8-8eb7-57dd7620d2ee None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.106719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9c102-33a4-48fe-90cf-893934871f47 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.114915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.141903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2247a-0512-44f8-8eb7-57dd7620d2ee None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.144416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.145858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.145858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.145858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.146475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:35.146822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.148284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1babbb8-1c1c-448c-b0a7-9f5a25a63bf8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:35.167887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 369/738] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:35.169224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.169516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.169785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.185384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.186600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.187142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.187653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.189955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:35.191291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:35.243041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.276477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 370/739] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:35.276477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.282043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.283594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:35.380910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.392608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9414111-4562-468e-8a8f-16c2fead7c86 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.407129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 370/740] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:35.408412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.434158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf34568-ba98-4ec3-bdd5-2ed7c9823390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.434728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf34568-ba98-4ec3-bdd5-2ed7c9823390 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.435034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf34568-ba98-4ec3-bdd5-2ed7c9823390 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.435335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf34568-ba98-4ec3-bdd5-2ed7c9823390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.499136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.521038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf34568-ba98-4ec3-bdd5-2ed7c9823390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.521977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfd33c-6b17-42c7-9aae-274b89c25a4d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.522507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf34568-ba98-4ec3-bdd5-2ed7c9823390 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:35.556552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.557181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.557455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.557720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.568168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:35.573091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:35.574057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:35.574937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 371/741] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:35.575641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.617954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.629583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 371/742] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:35.630944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ff1c-e601-4df0-9606-8700868d8bc2 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.631233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ff1c-e601-4df0-9606-8700868d8bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.631514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6ff1c-e601-4df0-9606-8700868d8bc2 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.632751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 372/743] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:35.634840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ff1c-e601-4df0-9606-8700868d8bc2 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.675898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43e63c-c0b6-456d-95c1-33e581001496 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.710418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.711109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.711442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.711715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.715552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.722663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.724196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:35.738868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:35.739926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:35.740803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:35.740803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:35.740803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:35.740981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6ff1c-e601-4df0-9606-8700868d8bc2 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.741058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 372/744] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:35.741447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.777855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.778513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.778830 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.779102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.779752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.781128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:35.797732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 373/745] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:35:35 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:35.803935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:35.844678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.853584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c223f-b4ed-42b0-9183-5e97723b0278 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.898308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.899000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.899550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.899777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.900326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:35.900934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.902118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b26c0c-0856-4a60-b8ec-e32b13d75bb9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:35.912538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 373/746] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:35.917719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.917719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.917719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.930561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d012278-0f14-478d-82e6-d3c8fc13b8a7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:35.935170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:35.936439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:35.970672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:35.971118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:35.971396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:35.971665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:35.980083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.986702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:35.989037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:36.004491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:36.005615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:36.006523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:36.006523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:36.006523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:36.006523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 374/747] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:36.006797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.026751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 374/748] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:36.026751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.125368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659493-4904-4b63-a1fa-93680c6576e9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.132859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.158186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad320-18a4-43d7-ad26-6a064beaf8b9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.172693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.173846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.174748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.175300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.176165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:36.176973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.178976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.201181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 375/749] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:36.202417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.202825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.203551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.203992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.204333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.216771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.219109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:36.235694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:36.236661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:36.237529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:36.237529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:36.237529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:36.241901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 375/750] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:36.242928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.268212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.332094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a59cf-68d4-4572-b662-1d3a4d57b875 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.353505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886f83e-ecdc-4fe3-ba16-f0885a1d4a01 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.368133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.368744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.369018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.369287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.369932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:36.370231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.371646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.388300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 376/751] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:36.388300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.396550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.397184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.397454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.397720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.400319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.406970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.409107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:36.421547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:36.422677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 376/752] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:36.428550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.500727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b04a-4283-45e9-b739-d271bcb08139 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.511711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.534941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945c6d0-fb85-4c89-bfb9-2ffd1306473a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.539817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.540568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.540848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.541126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.541890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:36.542267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.543771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.556469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 377/753] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:36.557341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.575707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.576325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.576605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.576875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.577524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.578935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.606903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 377/754] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:35:36 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:36.607927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.683068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.685390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9f64c-9362-478a-9fbc-3e8520de159c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.740711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.741551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.741899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.742307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.744314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a2936-d037-4354-91ae-c8b16dd9918a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.750814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.752306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:36.765242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:36.766381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:36.767553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:36.767988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 378/755] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:36.768690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.789145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.789818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.790094 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.790413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.791172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:36.791475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.792939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.806417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 378/756] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:36.807345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:36.809917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.902173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfe52d-5b0a-44ad-b9e6-b358c8fd09e0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.921512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368fde0-3bff-4279-858f-f23987b67cb4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:36.933736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.954962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.955501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.955742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.956010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.964636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.965758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:36.966222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.966930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:36.967411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:36.967902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:36.969759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:36.970642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:36.972315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:36.979579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:36.980602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:36.981579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 379/757] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:36.982190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:37.002737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 379/758] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:37.002737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:37.080886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:37.098293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60add-4c65-404b-bf3a-1758f4eb5b9e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:37.135344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:37.136133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.136505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.136871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.137721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=bc527e0ec230497cb664de8ea319ba7a) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:37.138113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:37.139694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:37.141197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344802c-6917-4bf6-8048-b965906f19c4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:37.147645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 380/759] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/role_assignments?user.id=bc527e0ec230497cb664de8ea319ba7a&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:37.147645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:37.190833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:37.191743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.192167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.192679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.193672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:37.196507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:37.198284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:37.248734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 380/760] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:35:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:37.254338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:37.305257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955febb7-4d52-4ee1-b15c-99a9ab4c19c7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:37.339547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:37.350901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:37.352779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.353261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.353682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.354590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=42e4f3e4ddd34ad689319b863afd6db5) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:37.355087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:37.356785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:37.365370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 381/761] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:37 2022] GET /identity/v3/role_assignments?user.id=42e4f3e4ddd34ad689319b863afd6db5&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:37.447876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32941e6-a4d3-4af6-9748-cb2a0fa53427 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:37.494538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:37.495491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.495920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.496369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.508797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:37.510538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:37.535545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:37.536673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:37.537570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:37.537570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:37.537570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:37.537570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 381/762] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:37.543417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:37.573376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:37.681045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626764c1-3b31-40af-8af1-0843b10daf96 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:37.718719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:37.718719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.718719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.718719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.719050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:37.719050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:37.719861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf9f4-56d7-4f55-be86-be4b8daa1919 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:37.741189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 382/763] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:37.749628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:37.784129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914327c-c046-432e-878f-52060d2f40a0 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.784328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914327c-c046-432e-878f-52060d2f40a0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.784581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914327c-c046-432e-878f-52060d2f40a0 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.786065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 383/764] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:35:37.793023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.793297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.793565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.817244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:37.818832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:37.892002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:37.935317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151ed27-ea8f-42a8-b85d-c1bb3ee14060 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:37.960741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 384/765] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 06 11:35:37.989878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:37.990537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:37.990843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:37.991114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:37.999171 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:38.000692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:38.018475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:38.019462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:38.020470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 382/766] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:38.027328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:38.031042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:38.137373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ee70-2221-47a6-8a88-a3c92d78f55d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:38.183891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:38.184509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:38.184788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:38.185058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:38.185758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:38.186059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:38.187538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:38.199846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 385/767] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:38.207774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:38.311835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a003a5d-179a-4f2e-864a-b924fcf5aa33 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:38.347268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:38.347980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:38.348261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:38.348529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/a782787a64c94d0f8a43f7f8deeb120b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:38.350518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=a782787a64c94d0f8a43f7f8deeb120b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:38.351994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:38.367706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:38.372111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 383/768] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:38 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/a782787a64c94d0f8a43f7f8deeb120b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:38.463944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:38.546255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:38.591505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6f91d-d7fd-4b01-90b4-6c952f664dce None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:38.632469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:38.633117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:38.633441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:38.633711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:38.634309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:38.635729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-fe447d11-a2e7-493f-b0e3-f3410b172f5c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:38.647545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:38.648577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:38.649422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 386/769] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Sep 6 11:35:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:38.654580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:38.774125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d39b-2074-4742-a31b-173d5bf350da None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:38.774668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d39b-2074-4742-a31b-173d5bf350da None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:38.774668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d39b-2074-4742-a31b-173d5bf350da None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:38.776715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 387/770] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:38.783244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700197ef-afc5-4390-90d6-191243664c56 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:38.783515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700197ef-afc5-4390-90d6-191243664c56 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:38.783798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700197ef-afc5-4390-90d6-191243664c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:38.816456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-700197ef-afc5-4390-90d6-191243664c56 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:38.817941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-700197ef-afc5-4390-90d6-191243664c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:38.836917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ab59-f633-4a81-be37-0e1402816815 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:38.900752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 388/771] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:38.911335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:38.912186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:38.912471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:38.912744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:38.913499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:38.913808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:38.915311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:38.920631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 384/772] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 6 11:35:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:38.931832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700197ef-afc5-4390-90d6-191243664c56 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:39.007627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:39.063953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700197ef-afc5-4390-90d6-191243664c56 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:39.111521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:39.112145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.112423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.112693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.113332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:39.113631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:39.115256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:39.121922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 389/773] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 6 11:35:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:39.127406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:39.218293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:39.261495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20f80-71f9-4bd7-a597-17be70539b25 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:39.295569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:39.296193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.296465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.296734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.297449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] RBAC: Adding query filter params (interface=public, service_id=642f07be91e447fe84db9f8eaaff94be, region_id=RegionOne) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:39.297756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:39.299175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:39.307318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 385/774] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:35:39 2022] GET /identity/v3/endpoints?service_id=642f07be91e447fe84db9f8eaaff94be&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:39.312413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:39.330342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:39.508743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e30f1a-7271-42b4-82e1-4c5718de41b9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:39.511132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fdfc9-37db-4d20-97f9-ef0436badfbf None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:39.558202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:39.568249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:39.580218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:39.581594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.582414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.583494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.584365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:39.585218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.586058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:39.586542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.587043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] PATH_INFO: `/v3/services/network` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.588260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:39.590432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:39.591263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:39.600697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 390/775] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:35:39 2022] GET /identity/v3/services => generated 772 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b697f5fa-55dc-4b90-b2ae-ad3830b14717 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:39.607155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:39.608225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:39.609067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:39.612213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 386/776] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:39 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:39.618670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:39.628045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546f92-6821-436b-86ea-bc305ac4b256 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.628388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546f92-6821-436b-86ea-bc305ac4b256 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.628598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546f92-6821-436b-86ea-bc305ac4b256 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.630286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 387/777] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:35:39.637419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13f6ef-ac60-4312-99fc-496a85860b1d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.637419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13f6ef-ac60-4312-99fc-496a85860b1d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.637419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13f6ef-ac60-4312-99fc-496a85860b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.675324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8e13f6ef-ac60-4312-99fc-496a85860b1d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:39.676694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8e13f6ef-ac60-4312-99fc-496a85860b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:39.773523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d3d5-3d05-4d8a-b8c7-be56de7c3d88 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:39.813713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34793521-df25-475d-98a8-9e325149d780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:39.814358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793521-df25-475d-98a8-9e325149d780 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.814602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793521-df25-475d-98a8-9e325149d780 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.814804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793521-df25-475d-98a8-9e325149d780 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.815425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34793521-df25-475d-98a8-9e325149d780 None admin] RBAC: Adding query filter params (name=network) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:39.815718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34793521-df25-475d-98a8-9e325149d780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:39.817193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34793521-df25-475d-98a8-9e325149d780 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:39.822593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 391/778] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:39.823195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 388/779] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:39.829915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34793521-df25-475d-98a8-9e325149d780 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:39.885750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:39.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34793521-df25-475d-98a8-9e325149d780 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:39.939999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d541b-5f9d-46e8-b5d2-7b58da742dd9 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.940482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d541b-5f9d-46e8-b5d2-7b58da742dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.940592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d541b-5f9d-46e8-b5d2-7b58da742dd9 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.943778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 389/780] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:39.947966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.948256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.948528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.973736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:39.974362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:39.974519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:39.974620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:39.974924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:39.975556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] RBAC: Adding query filter params (type=network) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:39.975752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:39.975854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:39.977218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:39.982882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 392/781] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:39.991706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.130063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 390/782] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:40.135730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.222057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:40.278870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac696c-8ef8-413c-bef6-3899d12ca155 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.336990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168297b4-0018-498a-b501-e269d1ac1de0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.342474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.343158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.343432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.343702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.355331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:40.361825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:40.362834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:40.363688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 391/783] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:40.365264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:40.369312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.416346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.416981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.417256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.417521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.418229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] RBAC: Adding query filter params (interface=public, service_id=3593ce8425ef4f509b8ca4c2eb177cab, region_id=RegionOne) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:40.418540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:40.419983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:40.434957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 393/784] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:35:39 2022] GET /identity/v3/endpoints?service_id=3593ce8425ef4f509b8ca4c2eb177cab&interface=public®ion_id=RegionOne => generated 194 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:40.440592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.517144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b797-1479-4769-aacf-eab81f6e0ded None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.532527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:40.557807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.558438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.558742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.559009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.559808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:40.560108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:40.561551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:40.571074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 392/785] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:40.571908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.572040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0654dc-5247-4238-9ee0-98664a2430eb None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.608694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.609315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.609592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.609861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.610463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:40.611867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:40.622843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 394/786] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:40.623851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.682043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cee4d-5548-4c14-ac37-692e89ffa0c0 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.697990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:40.762938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3c47d-7b9d-4e69-b463-ad5e816d225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.763617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddd351-d952-4559-adb1-49fadf4306c7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.763864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3c47d-7b9d-4e69-b463-ad5e816d225e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.764239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3c47d-7b9d-4e69-b463-ad5e816d225e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.764608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3c47d-7b9d-4e69-b463-ad5e816d225e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.781259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3c47d-7b9d-4e69-b463-ad5e816d225e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c7f3c47d-7b9d-4e69-b463-ad5e816d225e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:40.788264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:40.789317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:40.790159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 393/787] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:40.790896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa93b8-bb97-4868-b824-b6e16cdd1025 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.794706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa93b8-bb97-4868-b824-b6e16cdd1025 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.794706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa93b8-bb97-4868-b824-b6e16cdd1025 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.794706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 394/788] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:40.798163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa93b8-bb97-4868-b824-b6e16cdd1025 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.812849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.813677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.814022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.814642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.831342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:40.833560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:40.848192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-b9ef5523-d061-4698-827e-d45d0304347f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:40.853720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:40.855009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:40.855929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:40.855929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:40.855929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:40.855929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 395/789] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:40.858085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.858575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.859469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.881674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:40.883489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:40.934195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa93b8-bb97-4868-b824-b6e16cdd1025 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:40.971510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 396/790] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:40.973314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:40.978771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:40.979403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:40.979766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:40.980106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:40.980844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:40.981215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:40.982701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:40.994360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 395/791] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:40.999789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.015963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.120361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.127065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0769d-6c33-428e-af52-029a6c645f0e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.183289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.183941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.184277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.184485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.199206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cf9a3-99aa-4fd6-9657-445304a925ca None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.205270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.206787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:41.230895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:41.231896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:41.232791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:41.232791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:41.232791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:41.233846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 396/792] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:41.237852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.265944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.266575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.266887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.267159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.267808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:41.268127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.269497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.282898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 397/793] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:41.283848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.382649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7486bb7-598d-4975-8095-3887fac885ca None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.388139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.408870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846b2f-89bb-41ae-8d0c-eb1296a1bf60 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.428884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.430076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.430505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.431102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.432179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:41.432645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.434208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.451467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.452075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.452474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.453621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.457653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 397/794] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:41.459265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.468154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:41.472674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:41.475694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:41.476931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:41.477876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:41.485569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 398/795] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:41.486818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.584185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d4a1-75b1-4d68-b596-aacb97e30df0 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.601641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf44e6d-d370-423b-ba90-e328cd122f60 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.623344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.624332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.624754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.625166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.633232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.635062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.643915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.644641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.644990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.645330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:41.648472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:41.649407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:41.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:41.654743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.655087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.657221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 398/796] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:41.658270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:41.668483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:41.669489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:41.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 399/797] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:41.671038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.678048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.746353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.793213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92484c80-35b0-418d-9499-810a20b6551d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.799134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c81b5-fb87-45a8-a646-64a020c28084 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.836098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.836799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:41.837385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.837668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.837942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.838327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:41.838615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:41.838953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.839366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:41.839829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:41.840340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.840985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:41.841481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:41.843501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:41.855796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 399/798] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:41.855796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.872345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 400/799] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:41.873579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:41.946300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:41.976050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c3b03-3136-4b0f-9651-d605783bde17 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:41.987432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970552-812a-4233-b7c7-641794399bd0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.008400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.014968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.015591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.016471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.016471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.017238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:42.017527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.019002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.025192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.025852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.026122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.026385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.042918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 400/800] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:42.043127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.043223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.043308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-f0216cc3-b2a2-4e1c-9e08-a51a1a1df008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:42.058368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.059459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:42.060352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:42.060352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:42.060352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:42.060352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 401/801] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.061092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd6d2-08d1-415a-92eb-432cbdb16401 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.061390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd6d2-08d1-415a-92eb-432cbdb16401 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.061766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd6d2-08d1-415a-92eb-432cbdb16401 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.063151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 402/802] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:42.067784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dd6d2-08d1-415a-92eb-432cbdb16401 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.157445 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3c47-113d-4f72-8c13-7d5214dc6693 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.170850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dd6d2-08d1-415a-92eb-432cbdb16401 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.185483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.194929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.195621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.195898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.196163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.206901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.208467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.208708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.209358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.209663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.209909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.221198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.222646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:42.225037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.225977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:42.227733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:42.227733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:42.227733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:42.227733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 401/803] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.227733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-002068ee-ee5a-45c9-afac-1a38d78964fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:42.244989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.246012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:42.246985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:42.246985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:42.246985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:42.246985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 403/804] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.247825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.247825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.248004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.266471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:42.267713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:42.279788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.339933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 404/805] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:42.340668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.353210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7247-05a1-4999-8c44-d16d6055e7f5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.405487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.406472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.406996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.408012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.409156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:42.409701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.412299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.429672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 402/806] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:42.430893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.463859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.472551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de87b-2b9b-4a0c-9e0f-a8368a5c31b7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.518393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.519002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.519283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.519557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.520498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:42.520884 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.522522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.538231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 405/807] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:42.541063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.564776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.568326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c7ecc-13d0-4db6-bcbd-392039eb29af None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.609528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.610292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.610631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.611185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.611901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:42.612417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.613922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.626256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 403/808] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:42.627121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.670857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2716b9-5e70-4787-a15c-7eaf15d5673f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.704937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.705560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.705813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.706091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.717265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.718739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:42.730476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.731588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:42.732565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 406/809] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.733141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.744044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3667f5-3303-434f-840e-23e4764fd1ff None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.752869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.779897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.780450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.780722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.780991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.787737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.789182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:42.800322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.801377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 404/810] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.802314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.824249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.834938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6c4e-667a-4438-9deb-a4ef825c363b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.869097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.869794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.869989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.870261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.870887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.872258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-be9da2c3-63c3-4773-ab67-384bc2ac7adf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.881266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.882264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:42.883150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 407/811] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.883968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c53370-b86f-4055-aaf4-3193b7b68fb4 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.884076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c53370-b86f-4055-aaf4-3193b7b68fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.884360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c53370-b86f-4055-aaf4-3193b7b68fb4 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.885711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 408/812] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:42.886349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c53370-b86f-4055-aaf4-3193b7b68fb4 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.906041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23733c-9c7c-4c13-9208-ce0fbc0e016b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:42.939091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:42.939724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:42.939998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:42.940262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:42.947241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:42.948726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:42.960746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:42.961847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 405/813] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:42.963130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:42.973304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:42.996984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c53370-b86f-4055-aaf4-3193b7b68fb4 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.030231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.030792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.031050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.031316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.032041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:43.032340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.033771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.050558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 409/814] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:43.051453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.053367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.079124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34a54-6b02-423f-b8c5-9118966aed8b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.116479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.117147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.117425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.117698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.118402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:43.118747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.120203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431e28b-9d3e-4b8f-accb-d9c76d44abab None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.132603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 406/815] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:43.138063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.138063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.138063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.153856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:43.155185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:43.155466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff50fc-3c8d-4e4d-9958-92e3dcb9ad2c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.192197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.192839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.193192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.193383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.194014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:43.194296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.195710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.200121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 410/816] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 6 11:35:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:43.200822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.203499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.223874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 407/817] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:43.224707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.307055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1755-f246-4e8f-9767-f6bfdfccc61c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.312163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.342637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.343348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.343628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.343897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.344592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:43.344898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.346711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.346901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b194f-5ed4-4e81-b3f1-c0467d2a360f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.366011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 411/818] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:43.366658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.384326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.384946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.385222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.385476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.434631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.459991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.461568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.478673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caaf5e-26cb-4a46-8091-21d025d4bfad None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.521918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.522592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.522905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.523179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/bc527e0ec230497cb664de8ea319ba7a/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.525106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=bc527e0ec230497cb664de8ea319ba7a, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.526563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.535054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.541489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 412/819] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:43 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/bc527e0ec230497cb664de8ea319ba7a/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:43.542312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.570407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 408/820] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:35:43.571256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.662528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a5d16-1450-4948-a503-ab90c0aa3cdc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.690735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9e89-e88b-4a40-b0ca-1d9a9e550470 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.692984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.704200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.704825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.705097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.705361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.706001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:43.706297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.707697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.718810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 413/821] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 6 11:35:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:43.718810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.731159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.731835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.732200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.732387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/42e4f3e4ddd34ad689319b863afd6db5/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.748479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=42e4f3e4ddd34ad689319b863afd6db5, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.750086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.765295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 409/822] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:43 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/42e4f3e4ddd34ad689319b863afd6db5/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:43.766150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.804513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:43.863528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50468daa-0b62-40f5-b671-4283e1690506 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.913168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5c153-e3f1-4bcd-8bc8-3473222c0542 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:43.917732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.919018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.919437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.919851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.920584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.922849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:43.936062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:43.937162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:43.940125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 414/823] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:43 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:43.941114 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:43.966905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:43.967983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:43.968258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:43.970420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:43.983068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:43.984685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:44.000979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:44.002061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:44.002991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:44.002991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:44.002991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:44.002991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 410/824] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:44.004672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.014761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:44.084555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75729a95-9e29-4c59-8784-148d484b50a8 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.089775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:44.123361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdde33-6226-4e2b-bd60-ffe055ec2c17 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.125342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.126175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.126591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.127042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.127852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.129378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.155473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 415/825] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:35:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:44.156608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.180219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.180894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.181176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.181450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.182151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] RBAC: Adding query filter params (name=network) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:44.182460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.183961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.193832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 411/826] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:44.197287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.280725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958c9c3-2c6f-4f69-b0d2-c4b37c54c5ae None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.289922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:44.323165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.324119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.324663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.325073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.325877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:44.326352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.328042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.341586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 416/827] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:44.349045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.400916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589be2e-a9f2-4cc7-ac7a-5fa8908e8ade None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.443672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:44.450980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8261da-637b-4380-935c-ea8342146591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.451608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8261da-637b-4380-935c-ea8342146591 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.451886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8261da-637b-4380-935c-ea8342146591 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.452159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8261da-637b-4380-935c-ea8342146591 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.452797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8261da-637b-4380-935c-ea8342146591 None admin] RBAC: Adding query filter params (type=network) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:44.453148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8261da-637b-4380-935c-ea8342146591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.454772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8261da-637b-4380-935c-ea8342146591 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.463540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 412/828] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:44.469398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8261da-637b-4380-935c-ea8342146591 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.477934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0445f8-a70d-4793-82bd-e9f9b07f3665 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.521725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.522378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.522656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.523011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.534385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.535933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:44.548817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:44.549897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:44.550864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 417/829] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:44.555654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.610717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8261da-637b-4380-935c-ea8342146591 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.620214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:44.682806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.683359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.683637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.683908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.684613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.686121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.731668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 413/830] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:35:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:35:44.791257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4b1e-6a0c-4d5c-a624-208546abcab5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:44.886110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:44.886779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:44.887055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:44.887318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:44.888024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:44.888328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:44.889791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97e076-7b47-446b-b852-bfed5f961592 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:44.903577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 418/831] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:44.909552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:44.966988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:45.024030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045f3ba-d2d0-436d-ba3a-d51c141ae79a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:45.063459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:45.064325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:45.064739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:45.065146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:45.066016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=a782787a64c94d0f8a43f7f8deeb120b) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:45.066485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:45.068343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8173d-deab-4fd3-a0d6-d6ef98fd12d1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:45.075658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 414/832] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:44 2022] GET /identity/v3/role_assignments?user.id=a782787a64c94d0f8a43f7f8deeb120b&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:45.650073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cab81-831e-41d7-927d-ad88447c0a80 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:45.650642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cab81-831e-41d7-927d-ad88447c0a80 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:45.650642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cab81-831e-41d7-927d-ad88447c0a80 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:45.652217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 419/833] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:45.657801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba7b3-f5c6-4784-a21a-a52b10386975 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:45.658249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba7b3-f5c6-4784-a21a-a52b10386975 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:45.658338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba7b3-f5c6-4784-a21a-a52b10386975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:45.677175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-725ba7b3-f5c6-4784-a21a-a52b10386975 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:45.678372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-725ba7b3-f5c6-4784-a21a-a52b10386975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:45.749637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 415/834] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:45.899533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7efa-d632-470c-93ef-088640a82974 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:45.899942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7efa-d632-470c-93ef-088640a82974 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:45.900175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7efa-d632-470c-93ef-088640a82974 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:45.901557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 420/835] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:45.906933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:45.907451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:45.907926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:45.927400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:45.929001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:45.975196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.002273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 416/836] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:46.044875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7efa-d632-470c-93ef-088640a82974 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.135026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.155229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7efa-d632-470c-93ef-088640a82974 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.190361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.191032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.191308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.191574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.202102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:46.206996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:46.207920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:46.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 421/837] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:46.214475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.294788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.323842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb60a0d-8cf4-436e-9e12-e08ce09f30a9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.360926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.361964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.362465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.362916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.363729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:46.364177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:46.365794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:46.374641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 417/838] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:46.380833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.418470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913de5e-0fb9-452c-a6ee-22e690ca0591 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.428432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.453991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709479c0-4afa-4c78-9ba2-52ccef98fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.454628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709479c0-4afa-4c78-9ba2-52ccef98fe5f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.454933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709479c0-4afa-4c78-9ba2-52ccef98fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.455204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709479c0-4afa-4c78-9ba2-52ccef98fe5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.466124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709479c0-4afa-4c78-9ba2-52ccef98fe5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-709479c0-4afa-4c78-9ba2-52ccef98fe5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:46.471261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:46.472212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:46.473057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 422/839] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:46.473814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d5cb7-e375-436a-b09b-d065bab7a9e6 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.473884 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d5cb7-e375-436a-b09b-d065bab7a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.474824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d5cb7-e375-436a-b09b-d065bab7a9e6 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.479994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 423/840] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:46.479994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d5cb7-e375-436a-b09b-d065bab7a9e6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.485110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.501079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd8f3-0357-4281-811e-ad2adc307103 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.539150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.539907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.540253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.540730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.553218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:46.554700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c75c031c-df76-4ed7-9316-cb714471be50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:46.569351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:46.570514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:46.571579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:46.571579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:46.571579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:46.575670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 418/841] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:46.576851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.577139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.577410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.596168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:46.597332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:46.600769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d5cb7-e375-436a-b09b-d065bab7a9e6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.636634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.637267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.637536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.637810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.638473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:46.638805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:46.640196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:46.648642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 424/842] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:46.649462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.672097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 419/843] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:46.673693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.697074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.744240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.785845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76895b-3298-4ff6-b76a-4511ead5c14e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.812554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feaccd-abc4-4fe4-b484-141c9d0acd49 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.821713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.822475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.822894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.823273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.824005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:46.824406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:46.826101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:46.843099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 425/844] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:46.844919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.858571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:46.859720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:46.860140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:46.860577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:46.874841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:46.877374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:46.901199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:46.902294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:46.903216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:46.903216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:46.903216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:46.908621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 420/845] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:46.909728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.965299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7337d-5d5c-405c-a04c-88ae72729630 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:46.990357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.996683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.002585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.003248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.003526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.003797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.011910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.013368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:47.025376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:47.026334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 426/846] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:47.027754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.035250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f2d6-b4a4-4e37-8a09-18aa9d5eb289 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.072164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.072822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.073146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.073392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.074202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:47.074498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.076122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.094046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 421/847] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:47.094046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.131134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29dd7-85bd-4cbd-9bf7-bdedf6e2eae2 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.165758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.166371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.166646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.166967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.167547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.168922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-8e38cc28-45b3-4b05-a3c7-0e294afcef6b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:47.177762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:47.178918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.179810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 427/848] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:47.180738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7a74f-e515-49fe-9bef-62c7808002d0 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.180738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7a74f-e515-49fe-9bef-62c7808002d0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.180738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7a74f-e515-49fe-9bef-62c7808002d0 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.181686 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 428/849] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:47.182376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7a74f-e515-49fe-9bef-62c7808002d0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.198374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65537e9-78b9-402a-85fd-50307a80d920 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.231132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.232743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.237110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.237727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.238002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.238269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.239024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:47.239403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.240876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.258164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 422/850] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:47.259008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.289727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7a74f-e515-49fe-9bef-62c7808002d0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.323870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.324506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.324783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.325051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.332481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.333947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-8783dc01-c0c3-4e8f-9aa1-5f24c808bdd2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:47.345883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:47.347049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.348021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 429/851] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:47.348631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.348804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.349031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.362494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b9b1-fee7-4ce6-baf6-0997abebf7a1 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.366556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:47.367774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:47.398071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.398679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.398988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.399257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.399892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:47.400193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.401574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.406317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 423/852] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:47.406968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.444287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 430/853] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:47.445159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.467010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.491889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.523464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e806eb-929e-47e8-a5cc-ef869c002b68 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.557671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a50c86-fb44-4387-9b4b-5620920c8a83 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.558784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.559406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.559683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.559950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.593462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.594166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.594516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.594877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.596031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:47.596440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.597980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.617151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 431/854] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:47.617788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.641199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.642657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.703055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.717198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.723717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bcc9d-9f58-47a5-b6aa-9acf458735cf None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.753448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 424/855] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:35:47.754201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.761570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.762190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.762916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.763188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.763825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:47.764128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.765909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.770392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 432/856] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:47.771265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.866671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42fec-a96d-408a-a2e6-f41a9e16fafe None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.903206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9be7e-5acf-487d-adbb-0abe47d621c9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.908294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.908934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.909210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.909477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.938545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.945728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.946398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.946661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.946962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.947552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.948936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:47.958555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:47.959705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:47.960634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 433/857] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:47.961430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.990303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:47.992384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.994062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.075636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb646bcb-10ed-4ff5-a96d-a98afce1df59 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.105757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 425/858] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:35:48.105757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.110630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.111311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.111595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.111820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.122829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.124282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:48.139336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:48.140326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:48.141249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:48.141249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:48.141249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:48.141249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 434/859] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:48.142052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.174419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.227111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.233684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0446c27-7ac0-4b62-9ead-5985861c53b7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.254406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e3dc-ae28-40a5-9ccc-abe75ae9cafd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.270735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.271619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.272034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.272443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.273227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:48.273677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.275362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.282731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 426/860] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:48.282731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.298624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.299320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.299589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.299867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.312593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.314328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:48.331610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:48.332729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:48.333749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:48.333749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:48.333749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:48.333749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 435/861] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:48.333974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.390546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aede8-83eb-4fb5-bc91-6baee22cb93a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.409479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.429360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.430086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.430485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.430837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.431544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:48.431909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.433655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.451574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 427/862] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:48.451574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.455949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e49c-e511-45ce-8e0e-e378ceaf94c5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.482870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.493953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.494804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.495256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.496153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.496938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:48.497382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.499733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.505913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 436/863] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:48.507320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.566277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbbb97-cbe8-4919-9ff5-60086b85c147 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.608356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363568-305b-474c-956d-409aeef815ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.608823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363568-305b-474c-956d-409aeef815ae None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.609100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363568-305b-474c-956d-409aeef815ae None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.609417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363568-305b-474c-956d-409aeef815ae None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.610081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363568-305b-474c-956d-409aeef815ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:48.610386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363568-305b-474c-956d-409aeef815ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.612013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363568-305b-474c-956d-409aeef815ae None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.630348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 428/864] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:48.631405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363568-305b-474c-956d-409aeef815ae None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.659066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40626-48bd-428f-b17f-7b7b59697c32 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.682639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.705356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.706004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.706280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.706548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.717186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.718716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:48.731225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:48.732383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:48.733419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 437/865] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:48.744053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.765386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363568-305b-474c-956d-409aeef815ae None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.805768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.819808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.820925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.821940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.822376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.832017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.834238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:48.852632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:48.853790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:48.854943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:48.862506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 429/866] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:48.863659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.870399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803aba-c600-42e0-b2df-6fa6b7d2a811 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.918625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.919514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.919965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.920377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.921758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:48.922214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.924374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.942659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 438/867] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:48.951076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.974532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:48.980531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d172d-ea48-4c8e-bb06-d8fb65688777 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:49.016154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:49.017118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.017577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.018024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.018977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:49.019505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:49.021229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:49.039010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 430/868] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:49.040227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:49.072871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e3209-de9f-4f07-bf15-4fa25014908e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:49.087951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:49.113255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:49.113810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.114087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.114438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.115398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=bc527e0ec230497cb664de8ea319ba7a) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:49.115767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:49.117403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d2bf4-aab5-4337-8206-f7d4b68a32e9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:49.129368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 439/869] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/role_assignments?user.id=bc527e0ec230497cb664de8ea319ba7a&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:49.151985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b439-cc13-4860-b000-c2cd01ce88de None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:49.192117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:49.193187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.193672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.194152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.195147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=42e4f3e4ddd34ad689319b863afd6db5) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:49.195674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:49.197397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135351-3f1f-48ce-9089-fd4c13cd97d8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:49.204920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 431/870] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:49 2022] GET /identity/v3/role_assignments?user.id=42e4f3e4ddd34ad689319b863afd6db5&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:49.700856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71396-5c83-4510-919e-bb1dfd7a358d None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.701238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71396-5c83-4510-919e-bb1dfd7a358d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.701413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71396-5c83-4510-919e-bb1dfd7a358d None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.703001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 440/871] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:49.708376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804843-37e9-42af-8acf-d34c931b347a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.708770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804843-37e9-42af-8acf-d34c931b347a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.709146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804843-37e9-42af-8acf-d34c931b347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.728920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f4804843-37e9-42af-8acf-d34c931b347a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:49.730291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f4804843-37e9-42af-8acf-d34c931b347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:49.748722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:49.803340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 432/872] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:50.067245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71396-5c83-4510-919e-bb1dfd7a358d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:50.176954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71396-5c83-4510-919e-bb1dfd7a358d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:50.212943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692af01-0673-4ad4-a0a5-7631bd664a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:50.213984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692af01-0673-4ad4-a0a5-7631bd664a73 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:50.214469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692af01-0673-4ad4-a0a5-7631bd664a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:50.214958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692af01-0673-4ad4-a0a5-7631bd664a73 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:50.215831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692af01-0673-4ad4-a0a5-7631bd664a73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:50.217427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692af01-0673-4ad4-a0a5-7631bd664a73 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:50.235050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 441/873] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:35:50 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:50.439536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba8ff-f423-45d0-b0af-930a774e7b5e None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:50.439882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba8ff-f423-45d0-b0af-930a774e7b5e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:50.440121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba8ff-f423-45d0-b0af-930a774e7b5e None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:50.441773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 433/874] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:50.447095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28a2c-6e8b-4122-98c9-940dfdb2b82a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:50.447385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28a2c-6e8b-4122-98c9-940dfdb2b82a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:50.447663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28a2c-6e8b-4122-98c9-940dfdb2b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:50.466766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-faf28a2c-6e8b-4122-98c9-940dfdb2b82a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:50.467972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-faf28a2c-6e8b-4122-98c9-940dfdb2b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:50.498631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:50.552639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 442/875] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:50.814180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba8ff-f423-45d0-b0af-930a774e7b5e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:50.921151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba8ff-f423-45d0-b0af-930a774e7b5e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:50.956557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1a4f5-4009-43cd-9a0b-4a618584c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:50.957548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a4f5-4009-43cd-9a0b-4a618584c3fb None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:50.958018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a4f5-4009-43cd-9a0b-4a618584c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:50.958543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1a4f5-4009-43cd-9a0b-4a618584c3fb None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:50.959425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1a4f5-4009-43cd-9a0b-4a618584c3fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:50.961010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1a4f5-4009-43cd-9a0b-4a618584c3fb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:50.981405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 434/876] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:35:50 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:51.112921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecff0b-4503-43ae-bf48-c6da02d389f3 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.113473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecff0b-4503-43ae-bf48-c6da02d389f3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.113473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecff0b-4503-43ae-bf48-c6da02d389f3 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.115307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 443/877] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:51.121013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a007153-2482-416a-bcf0-883ad84d1022 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.121514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a007153-2482-416a-bcf0-883ad84d1022 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.122030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a007153-2482-416a-bcf0-883ad84d1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.142039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0a007153-2482-416a-bcf0-883ad84d1022 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:51.144833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0a007153-2482-416a-bcf0-883ad84d1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:51.152087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:51.225253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 435/878] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:51.263280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f802cb-24e5-4849-bcf7-87db69a7d2cf None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.263473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f802cb-24e5-4849-bcf7-87db69a7d2cf None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.263737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f802cb-24e5-4849-bcf7-87db69a7d2cf None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.265336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 444/879] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:51.270716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.271248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.271746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.290846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:51.292407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:51.364280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 436/880] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:51.500460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f802cb-24e5-4849-bcf7-87db69a7d2cf None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:51.604623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f802cb-24e5-4849-bcf7-87db69a7d2cf None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:51.633932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:51.639643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:51.640278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.640550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.640814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.641392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:51.642781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:51.657404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:51.658482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:51.659357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 445/881] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:51.666808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:51.703168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:51.720719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:51.766237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0507af-a4ae-4cf0-8b62-fda59e83d735 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:51.799221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf89e-ba85-4753-b938-8c8570cdb5bc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:51.802451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:51.803026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.803309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.803580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.814642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:51.819873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:51.820834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:51.822170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 437/882] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Sep 6 11:35:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:51.826717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:51.845404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:51.846556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:51.847020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:51.847428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:51.848444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:51.849385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:51.850948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:51.858040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 446/883] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:35:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:51.863530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:51.956373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8c0e-6c8a-4733-ae8d-8a5490b627ca None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:51.963295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:51.976032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ae56d-77c4-413f-9414-cc3ce1d7a9cc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:51.996029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:52.009314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.010870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.011327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.011794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.012643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:52.013117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.014666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.014978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.015706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.016052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.016393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.017165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:52.017602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.019038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.027137 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 438/885] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:35:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:52.030798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 447/885] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:35:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:52.032533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.149655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0150a8a-a201-45b9-a8c7-d8fe03508d0e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.189143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.190111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.190570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.191037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.202621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.204370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-94afe7e7-2b5e-49e7-a955-f612863b8e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:52.219586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:52.221052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:52.221941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:52.221941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:52.221941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:52.223883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 439/886] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:52.230566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.262881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5173-05e6-4e70-91b0-9679574f5a77 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.263157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5173-05e6-4e70-91b0-9679574f5a77 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.263421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5173-05e6-4e70-91b0-9679574f5a77 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.264999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 440/887] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:35:52.269937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.270217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.270485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.289352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:52.290560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:52.332291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:52.362833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffc55-ea37-4bc7-8961-e8b559d581c9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.374559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 441/888] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:52.400570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.401485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.401937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.402403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.403259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:52.403735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.405280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.418945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 448/889] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:52.429726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.534483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e69d9-4880-4641-a583-b08dde3f6ab9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.570625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.571295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.571568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.571835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.579398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.580844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:52.592826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:52.593816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:52.594797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 442/890] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:52.602178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.623146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:52.633261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.679065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:52.734707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116b1b-9408-427d-8fbc-e64e5057f07f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.776117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28827d20-3306-474a-9a70-cca9d1d123f4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.780630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.781376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.781750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.782164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.783030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:52.783431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.785007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.803481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 449/891] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:52.812577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.818172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.818997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.819371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.819737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.820428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.822358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:52.834194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:52.835243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:52.836090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:52.836849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 443/892] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:52.842997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:52.889678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:52.924510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f687-d4ea-4ffb-a08b-f19d154f1b49 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.946343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:52.954108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988389a-ef3d-4580-a4f6-47f6da4fa8c2 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:52.962265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806ea88-bc16-4d52-a7f2-d376ca7e6e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.963267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806ea88-bc16-4d52-a7f2-d376ca7e6e1e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.963744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806ea88-bc16-4d52-a7f2-d376ca7e6e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.964207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806ea88-bc16-4d52-a7f2-d376ca7e6e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.992395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:52.993397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:52.993684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:52.993958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:52.994606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:52.994944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:52.997157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.005246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 444/893] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:53.013278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.042822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806ea88-bc16-4d52-a7f2-d376ca7e6e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.044543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806ea88-bc16-4d52-a7f2-d376ca7e6e1e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.133263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:53.144714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17fac-b483-4576-85ca-0c437d9614aa None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.169502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 450/894] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:35:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 11:35:53.171530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb5f4-708a-40f8-90af-2d15c1d01425 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.172094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb5f4-708a-40f8-90af-2d15c1d01425 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.172533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb5f4-708a-40f8-90af-2d15c1d01425 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.174781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 451/895] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:53.175827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cb5f4-708a-40f8-90af-2d15c1d01425 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.184131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.184742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.185014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.185279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.185905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:53.186540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.187627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4605-145e-4100-b273-b5291b6219dd None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.192661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 445/896] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:53.193635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.193963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.194234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.212333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:53.213537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:53.233282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:53.287636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 446/897] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:53.288877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.299178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cb5f4-708a-40f8-90af-2d15c1d01425 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.342700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.343734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.344579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.345372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.359777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.362452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:53.385916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:53.386958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:53.387848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:53.387848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:53.387848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:53.388569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 452/898] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:53.393572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.396840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c7f4f-29e2-4d43-9a64-85d75c7e4eae None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.425416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:53.443555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.444185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.444461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.444733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.445460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] RBAC: Adding query filter params (interface=public, service_id=ff27b125494a466fb7618b8396ce5964, region_id=RegionOne) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:53.445752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.447306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.453651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 447/899] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/endpoints?service_id=ff27b125494a466fb7618b8396ce5964&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:53.459950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.486072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:53.528296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c24a5-c046-4cad-97f1-19440f216f0f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.573915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.575199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.576069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.576548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.577386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:53.577880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.580692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.595890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0835b4-6a33-482e-9eda-6d04a6df957e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.597831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 453/900] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:53.599570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.633204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.633822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.634097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.634367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.635014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.636422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.650725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 448/901] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:35:53.650725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.715835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:53.744305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5705d1-25f9-4308-b4b1-aefcfb4f124b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.754135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:53.775394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6d3d5-0162-42e9-8002-e44f3e9b915f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.798242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.799697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.800053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.800385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.801330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.802919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:53.816627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:53.817924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:53.819049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:53.822365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 454/902] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:53.825013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:53.825013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.825013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.825013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:53.827076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.835409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:53.837092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:53.852799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:53.854497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:53.855710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:53.858829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 449/903] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:53.861652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:53.963609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8b95-508a-420d-a58e-f5f931af9bf7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:53.975451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8258f-52b8-4445-89e7-2a7509ff8c43 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:54.000797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.001320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.001592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.001865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.002476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:54.002802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.004181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80059d00-b1e9-4d73-b2dc-ce52a4e03d0d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.010015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 455/904] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:54.011122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7bde7-bac3-46d6-8572-0a75327301a9 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.011404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7bde7-bac3-46d6-8572-0a75327301a9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.011681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7bde7-bac3-46d6-8572-0a75327301a9 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.016819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 456/905] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:54.016819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7bde7-bac3-46d6-8572-0a75327301a9 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:54.018614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.019219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.019495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.020634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.020634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:54.020806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.022219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2e9de-e9e1-4f5e-8f7c-0d8dcdf35df3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.032276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:54.035518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 450/906] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:54.036747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.037006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.037275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.053177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:54.059045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:54.060245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:54.128200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7bde7-bac3-46d6-8572-0a75327301a9 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:54.136487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 451/907] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:54.137138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:54.174398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.175197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.175478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.175746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.176551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:54.176897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.179183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.185014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 457/908] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:54.190864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:54.259499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91bd84-11a8-43a6-b300-1924153af3d8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:54.291156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:54.292878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:54.299145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.300282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.300995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.301365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.302357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] RBAC: Adding query filter params (role.id=f880c51658ff4a3f9c1dfd22e8bf999a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=42e4f3e4ddd34ad689319b863afd6db5) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:54.303036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.304607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.315148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 452/909] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:35:54 2022] GET /identity/v3/role_assignments?user.id=42e4f3e4ddd34ad689319b863afd6db5&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=f880c51658ff4a3f9c1dfd22e8bf999a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:54.322193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ba147-04da-492c-9a1a-7ef55606debd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:54.365000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.365902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.366325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.366800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.367698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] RBAC: Adding query filter params (interface=public, service_id=9df83d3bd38e4aa69aaf7252e27bfb62, region_id=RegionOne) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:54.368160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.369752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.376451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 458/910] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:35:54 2022] GET /identity/v3/endpoints?service_id=9df83d3bd38e4aa69aaf7252e27bfb62&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:54.384911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:54.400314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:54.501013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70b2e2-4275-4daa-a63e-745e6e2360c4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:54.520181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d3da-f040-4c09-aa4a-353aaca44e58 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:54.545507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3be403-146e-4cf4-b74a-695f7c2aaa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.546539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3be403-146e-4cf4-b74a-695f7c2aaa7c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.546934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3be403-146e-4cf4-b74a-695f7c2aaa7c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.547360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3be403-146e-4cf4-b74a-695f7c2aaa7c None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.548330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3be403-146e-4cf4-b74a-695f7c2aaa7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.550523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3be403-146e-4cf4-b74a-695f7c2aaa7c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.557155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742734-b1c1-475e-921a-19f97d6355d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:54.557963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742734-b1c1-475e-921a-19f97d6355d0 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:54.558383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742734-b1c1-475e-921a-19f97d6355d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:54.558822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742734-b1c1-475e-921a-19f97d6355d0 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.559753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742734-b1c1-475e-921a-19f97d6355d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:54.561337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742734-b1c1-475e-921a-19f97d6355d0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:54.566000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 453/911] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:35:54 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:35:54.576117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:54.582942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 459/912] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:35:54 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:35:55.647423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7a18-1bce-4fcc-b044-1a2fb546245c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:55.648016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7a18-1bce-4fcc-b044-1a2fb546245c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:55.648016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7a18-1bce-4fcc-b044-1a2fb546245c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:55.649558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 454/913] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:55.654735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:55.655184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:55.655276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:55.674876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:55.676112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:55.765285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 460/914] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:56.027694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f7a18-1bce-4fcc-b044-1a2fb546245c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:56.094553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:56.140079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f7a18-1bce-4fcc-b044-1a2fb546245c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:56.175575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:56.176262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.176543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.176882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.177466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:56.178896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-40ea0157-f7f3-4c7f-9bfd-dec9ba3d6a5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:56.188022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:56.189068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:56.190336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 455/915] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:56.195818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:56.300298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0f34-09d7-42fe-bf32-862d3d1455ab None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.300492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0f34-09d7-42fe-bf32-862d3d1455ab None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.300741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0f34-09d7-42fe-bf32-862d3d1455ab None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.302382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 456/916] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:35:56.304295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a332ea-a50f-41d0-8a2b-23556f50a33c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:56.307209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75989-e710-450f-9623-99c72dcf5a39 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.307489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75989-e710-450f-9623-99c72dcf5a39 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.307754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75989-e710-450f-9623-99c72dcf5a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.326345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-96b75989-e710-450f-9623-99c72dcf5a39 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:56.327571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-96b75989-e710-450f-9623-99c72dcf5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:56.331487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:56.343334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:56.344359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.344853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.345682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.346847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:56.347382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:56.349929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:56.363038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 461/917] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:56.364598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:56.430711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 457/918] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:56.480554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312f0d-b2cc-4156-821d-961aacb0e0c1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:56.515459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:56.516080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.516352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.516732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.517611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:56.517911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:56.519317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:56.525400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 462/919] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 6 11:35:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:56.529228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76ef37-63f2-4a72-a06a-65eccf8b9608 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.529514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76ef37-63f2-4a72-a06a-65eccf8b9608 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.529787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76ef37-63f2-4a72-a06a-65eccf8b9608 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.531405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 458/920] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:56.536070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:56.536403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9940c-37d0-48b8-b704-99babb103c2e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.536639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9940c-37d0-48b8-b704-99babb103c2e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.536942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9940c-37d0-48b8-b704-99babb103c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.557722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-c3f9940c-37d0-48b8-b704-99babb103c2e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:56.558865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c3f9940c-37d0-48b8-b704-99babb103c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:56.606210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:56.623236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:56.650853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 459/921] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:56.652419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980c2b-25d1-430d-a81b-47a319ea83b8 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.652687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980c2b-25d1-430d-a81b-47a319ea83b8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.652960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980c2b-25d1-430d-a81b-47a319ea83b8 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.654279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 460/922] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:56.660169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.660453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.660728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.663172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a8c97-d99c-427d-921e-ebee1d1278b4 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:56.689656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:56.691235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:56.700133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:56.701051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.701519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.702019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.702899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:56.704489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:56.727600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 463/923] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:35:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:56.728508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:56.807040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 461/924] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:35:56.858603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891fab0-6cd1-400f-bf20-cb062d3669b5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:56.875115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:56.898887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:56.899572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:56.899850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:56.900118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:56.910668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:35:56.912885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:35:56.917398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:56.918337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:56.919275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 464/925] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Sep 6 11:35:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:56.925030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.049248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da0a8a-5af7-453f-b55b-7836885a0210 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.049530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2504-c035-42f8-a146-ac973e1ca8aa None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.064838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.089691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.090560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.091069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.091485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.092301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.092764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.094288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.097809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.098459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.098927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.099199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.099785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.101257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.113993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 465/926] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:35:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:57.113993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:57.127218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:57.128311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:57.129203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 462/927] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:57.130078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.169541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.237151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988970b-0a86-4d33-b9d0-7b146ebc07fb None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.278524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5228802-50e0-4cbe-a142-7def84718857 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.279406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.280479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.281603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.281889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.293163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.294625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:57.309998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:57.311052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:57.311950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:57.311950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:57.311950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:57.311950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 463/928] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:57.312736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.318285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.318962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.319223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.319478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.320061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.321443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:57.331161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:57.332295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 11:35:57.333419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:57.337368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 466/929] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:57.338205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.348532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.433967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f79baa-9c69-413c-a302-ba98057fc48f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.441245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.448923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca872d-75da-4477-8a0b-0e99618196c1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.474805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.475414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.475694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.475956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.476586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.476888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.478295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.485725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.486412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.486778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.487109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.487999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 464/930] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:57.488115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.488410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.488867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.490060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.504745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 467/931] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:57.505857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.589871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.601794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877fb2-a647-49a3-93aa-c3c91a748939 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.614223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaff39-a7d7-49bb-9348-23be8f4fb1a9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.637622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.638415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.638820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.639260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.639994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.640393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.641869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.647290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 465/932] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:57.649437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.650117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.650452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.650888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.651580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.652092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.653154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.653743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.663691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 468/933] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:57.663691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.687915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.769167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3e83f-2cc5-4e3d-afe5-821804c05aef None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.775155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ac51-931a-4019-a549-b63b96c82807 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.808906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.809517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.809785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.810047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.810663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.810987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.811546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.812188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.812345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.812495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.812733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.822194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 469/934] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:57.822194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.824216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.825357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:35:57.837781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:57.838816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 466/935] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:57.839782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:57.858976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.920265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:57.940247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c08d-d60a-4073-8c86-c0f8d2a0935e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.950133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c579b5-22da-412d-9dea-75e0dff747c8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:57.987370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.988320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.988602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.988876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.989706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] RBAC: Adding query filter params (interface=public, service_id=dfe285b5ffc941da955c3c82c31e6c9b, region_id=RegionOne) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:57.990017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.991425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.991527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:57.992118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:57.992395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:57.992663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:57.993328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:57.994720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:57.996899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 470/936] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/endpoints?service_id=dfe285b5ffc941da955c3c82c31e6c9b&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:57.997681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:58.023982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 467/937] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:35:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:58.025772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:58.123012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ec73f-2595-46f5-bd70-29c60a4d48e3 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:58.137310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:58.183648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:58.184416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.184739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.185085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.185833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:58.186140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:58.186676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee07d-725a-40b4-9f4f-b61a75874e5f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:58.188409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:58.210929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 471/938] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Sep 6 11:35:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:58.216355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:58.220922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:58.236180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:58.236810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.237479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.237757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.238536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:58.240139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:58.248301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 468/939] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:35:58 2022] GET /identity/v3/services => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:35:58.340257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38919-d8da-400a-8e22-117fdc309650 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:58.382631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:58.383592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.384013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.384457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.397231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:58.399087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:35:58.416116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:58.417157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:35:58.418032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:35:58.418032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:35:58.418032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:58.418032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 472/940] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:35:58.422990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:58.538816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738392-cbf5-49cf-9ab8-497665d7e53c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:58.568771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:58.574826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:58.575645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.576264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.576542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.577255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:58.577941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:58.579443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:58.597271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 469/941] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:35:58.598740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:58.655794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:58.702268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddabaf-6c18-4010-9465-0f7aa59286a9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:58.738558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:58.739533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.739952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.740361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.748787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:58.750224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-bf8b46b0-b9bd-48d6-b8ca-aeb005d5e544 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:58.762444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:58.763414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:58.764333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 473/942] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:58.772066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:58.803663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ddbb-0e45-4483-bc27-4af2076e465a None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.803848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ddbb-0e45-4483-bc27-4af2076e465a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.804113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ddbb-0e45-4483-bc27-4af2076e465a None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.805714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 474/943] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:35:58.810736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.811025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.811298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.834161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:58.835084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:58.883906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71006e75-52bd-42b1-90fb-0623001eb064 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:58.920388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 475/944] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:35:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:35:58.922534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:58.923212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:58.923487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:58.923757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:58.924466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:58.924769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:58.926212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:58.946811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 470/945] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:58.948319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:59.004005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:59.061262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc01c24-fd21-45ad-9eae-5f3ee503b059 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:59.100601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:59.101612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:59.102136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:59.102598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/42e4f3e4ddd34ad689319b863afd6db5/roles/f880c51658ff4a3f9c1dfd22e8bf999a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:59.105025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=42e4f3e4ddd34ad689319b863afd6db5, role_id=f880c51658ff4a3f9c1dfd22e8bf999a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:59.106750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:59.126856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 476/946] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:35:58 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/42e4f3e4ddd34ad689319b863afd6db5/roles/f880c51658ff4a3f9c1dfd22e8bf999a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:59.230027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:59.289492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:59.345416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28872470-054c-47c4-a2d9-4557fbefca6d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:59.380621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:59.381324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:59.381605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:59.381877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:59.382585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:59.384125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:59.386864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING keystone.server.flask.common [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 11:35:59.408386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.sql.core [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 11:35:59.408386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 11:35:59.408386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [parameters: {'id': 'f34504a04f81482d9e7badbd7d12b63b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 11:35:59.408386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88032) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f34504a04f81482d9e7badbd7d12b63b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f34504a04f81482d9e7badbd7d12b63b. Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:35:59.416308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result.read() Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 11:35:59.417505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application yield resource Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise self.value Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application session.commit() Sep 06 11:35:59.418732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.session.flush() Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application compat.raise_( Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 11:35:59.419658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 11:35:59.420642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result.read() Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:35:59.421488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [parameters: {'id': 'f34504a04f81482d9e7badbd7d12b63b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:59.422422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:59.429447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f34504a04f81482d9e7badbd7d12b63b. Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:35:59.431672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 471/947] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Sep 6 11:35:59 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:59.435796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:59.559895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c23d2-7cee-4646-af37-89a83c6f7bed None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:59.562370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:59.598306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:59.598925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:59.599249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:59.599516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:59.606479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:59.607943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-af53207f-af80-4ad8-bdc9-ded171d6cb2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:35:59.619572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:35:59.620495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:35:59.621468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 477/948] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:35:59.629074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:59.733375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89529b9-4db2-4b14-a887-0276318d2811 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:59.742074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:59.770290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:59.771067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:59.771345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:59.771611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:59.772334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:59.772891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:59.774276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60745b-105f-4112-a72f-cd1a6eb89b33 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:59.802150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 472/949] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:35:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:00.138917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0de405-8302-497e-bdad-b89e1ab7055b None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.139494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0de405-8302-497e-bdad-b89e1ab7055b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.139494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0de405-8302-497e-bdad-b89e1ab7055b None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.141068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 478/950] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:00.146584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9832-9092-4c10-b58c-5eb8be0a4ce0 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.146899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9832-9092-4c10-b58c-5eb8be0a4ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.147177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9832-9092-4c10-b58c-5eb8be0a4ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.167144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2e3d9832-9092-4c10-b58c-5eb8be0a4ce0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:00.168693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2e3d9832-9092-4c10-b58c-5eb8be0a4ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:00.237909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 473/951] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:00.267540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcfdae-406b-4f15-b084-d94fa6072278 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.267903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcfdae-406b-4f15-b084-d94fa6072278 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.268081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcfdae-406b-4f15-b084-d94fa6072278 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.269781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 479/952] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:00.275772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.276093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.276320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.295496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:00.296757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:00.371478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 474/953] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:00.612218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcfdae-406b-4f15-b084-d94fa6072278 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:00.633531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:00.662453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:00.735533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcfdae-406b-4f15-b084-d94fa6072278 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:00.767477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd2ab-761a-4a16-9188-67ee420c6d9f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:00.790335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:00.791362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.792385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.792884 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.793939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:00.796491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:00.806881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:00.807529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.807839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.808109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.808693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:00.810065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:00.810273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:00.811526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:00.812440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:00.816238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 480/954] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:00.822740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:00.823928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:00.824906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:00.825652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:00.827611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 475/955] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:36:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:00.828433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:00.873047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:00.950002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:00.960793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937ee7f-e055-4013-b12b-f7bbef5b2c8b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:00.967642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25f12e-18f1-44d7-8cf9-e0c374a2c34b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.006783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.007393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.007672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.007938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.008687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:01.008992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.009662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.010393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.010779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.011251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.011806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.012722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:01.013225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.014810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.020903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 481/956] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:36:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:01.022624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.026750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 476/957] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:36:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:01.030464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.127996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:01.137755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aed48-535b-4e20-a64a-04ce84a3d8b9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.162443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6b195-8fc9-4b2c-9d9e-b538377c4d4e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.185780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.186480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.186679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.187119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.187760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:01.188062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.190100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be299-154f-4b98-98c5-7db73f27caa5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.196943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 482/958] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:01.207427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8ba5-0eb3-4d62-982f-c736d1278ab9 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.207743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8ba5-0eb3-4d62-982f-c736d1278ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.207979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8ba5-0eb3-4d62-982f-c736d1278ab9 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.209688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 483/959] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:36:01.215365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.215646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.215914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.218969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.219890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.220697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.221138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.222115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:01.222630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.224633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.233060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 477/960] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:01.237391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:01.238576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:01.239011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.262477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:01.325335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 484/961] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:01.364461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a92d4-8e2f-427d-b28e-8c8ada73deab None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.401000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.401944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.402468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.402944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.403802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.405422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.427875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 478/962] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:36:01.603792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.690661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:01.706077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e863701-a9e3-440a-96be-68bc8ef48d29 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.751053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b691f9-0eba-45f4-ad98-05e4db467b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.752113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b691f9-0eba-45f4-ad98-05e4db467b1c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.752537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b691f9-0eba-45f4-ad98-05e4db467b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.752956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b691f9-0eba-45f4-ad98-05e4db467b1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.764215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b691f9-0eba-45f4-ad98-05e4db467b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-89b691f9-0eba-45f4-ad98-05e4db467b1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:01.769332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:01.770489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:01.771641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:01.774022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 485/963] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:01.779891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.850501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d1b2-54ed-4911-aeae-611132adddf5 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.851212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d1b2-54ed-4911-aeae-611132adddf5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.852294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d1b2-54ed-4911-aeae-611132adddf5 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.853902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 486/964] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:01.859684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.859848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:01.860735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.861211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.880500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:01.881996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:01.889605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ebe6f-232c-4085-bc55-0076ec90eb38 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.927186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.927811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.928091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.928361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.929035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:01.929355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.930932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.945978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 479/965] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:01.947389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.954984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 487/966] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:02.053142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c2042-88f6-4734-98c8-19fbfc76f232 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.093900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.094554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.094867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.095501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.098230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.107167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.108803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:02.123310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:02.124285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:02.125205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:02.125205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:02.125205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.125205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 480/967] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:02.130527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.206370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.236438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.238487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83934ecc-a028-41e9-b647-71bc79717b45 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.280077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.280824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.281165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.281502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.282493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:02.282891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.284408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.300035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 488/968] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:02.308346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.377664 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1ddeb-8bd6-4aea-9b68-fa97b3f16894 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.424844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.425575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.425852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.426124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.426826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.428467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.437335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f990871-5946-4bee-ac6f-3e23c6b74747 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.445616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.sql.core [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 11:36:02.445616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 11:36:02.445616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [parameters: {'user_id': '7243001df2ad4148b0ab5d35834ee1ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 11:36:02.445616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88032) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result.read() Sep 06 11:36:02.453392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:36:02.454285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application yield resource Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise self.value Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application session.commit() Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 11:36:02.455305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.session.flush() Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application compat.raise_( Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 11:36:02.456796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:36:02.458811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application result.read() Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:36:02.461109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [parameters: {'user_id': '7243001df2ad4148b0ab5d35834ee1ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:02.462396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 11:36:02.464433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 481/969] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 6 11:36:02 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:02.465711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.471135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.477704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.478802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.479223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.479741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.489457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.491441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:36:02.508043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:02.509095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 11:36:02.510033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:02.514296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 489/970] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:02.515460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.551753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.610561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8bb63-17a2-4281-8498-545242f69193 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.640390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74221cc-ac91-4061-bbfd-d60db1f2b895 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.650705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.651490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.651867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.652235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.660151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.661933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:36:02.674333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:02.675521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 11:36:02.676674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:02.678457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 482/971] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:02.683827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.694249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.695183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.695784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.696245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.697281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:02.697785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.699439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.724395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 490/972] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:02.730767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.802920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.810333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d3f95-9409-41eb-969b-105a57c6c31e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.822867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.855819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.856730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.857013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.857285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.858429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:02.858795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.860876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.865231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898cb87-4adc-45b6-bc4c-8f7f9efc89ea None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.902477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.903528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.904015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.904489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.914732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 483/973] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:02.997324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.999399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.056035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.115843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 491/974] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:03.121913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.235780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f9da-2b0e-438b-b936-ecd684fad267 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:03.273699 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:03.274234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.274510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.274806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.285189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.286677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-fdd967c2-31d2-4b16-bafb-3a93aa369f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:03.301534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:03.302657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:03.303623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:03.303623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:03.303623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:03.303623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 484/975] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:03.309623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.333573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b9427-2903-4c4d-8047-64c6336628f2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.333816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b9427-2903-4c4d-8047-64c6336628f2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.334090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b9427-2903-4c4d-8047-64c6336628f2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.335475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 485/976] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:36:03.340593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105e03e-fa59-4d0f-9e9f-2b331be86c4e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.340885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105e03e-fa59-4d0f-9e9f-2b331be86c4e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.341135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105e03e-fa59-4d0f-9e9f-2b331be86c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.359654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f105e03e-fa59-4d0f-9e9f-2b331be86c4e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:03.361164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f105e03e-fa59-4d0f-9e9f-2b331be86c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:03.376870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.415265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99885d1-83e4-4da8-891d-24b55ed8be10 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:03.430536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 486/977] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:03.431910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aee7b-5930-403a-8831-4aa3dbeced6b None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.432193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aee7b-5930-403a-8831-4aa3dbeced6b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.432451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aee7b-5930-403a-8831-4aa3dbeced6b None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.433706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 487/978] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:03.439220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.439492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.439762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.454118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:03.454754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.455030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.455290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.455929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:03.456224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.457587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.457850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:03.459166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:03.474188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 492/979] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:03.475611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.489588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.534673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 488/980] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:03.586043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f1545-2aea-4434-9b77-7559277ba735 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:03.622525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:03.623201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.623481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.623753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.631681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.633159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:36:03.645381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:03.646293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:03.651707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 493/981] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:03.654514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.702969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.748717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.772663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52852451-ebc3-4b7b-b2aa-f1fa0288f43c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:03.787277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.808181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:03.808800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.809076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.809345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.810072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:03.810379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.811865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.821789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022fd52-96dd-417b-8d67-695ec93d2acd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:03.823823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 489/982] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:03.824616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.856678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:03.857297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.857572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.857843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.858514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.859921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.876022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 494/983] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:36:03 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:36:03.877112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:03.932070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94429-11db-4828-abc3-949b1e07f02c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:03.982832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:03.983503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:03.983786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:03.984059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.984678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.986061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.990028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:03.999384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:04.000489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:04.001376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 490/984] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:36:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:04.003539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d94f-b417-44e5-a54f-b508c37fd7cc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:04.008246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:04.039530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:04.047140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:04.047783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:04.048054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:04.048691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:04.049240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] RBAC: Adding query filter params (role.id=f880c51658ff4a3f9c1dfd22e8bf999a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=42e4f3e4ddd34ad689319b863afd6db5) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:04.049905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:04.051887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:04.058345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 495/985] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:03 2022] GET /identity/v3/role_assignments?user.id=42e4f3e4ddd34ad689319b863afd6db5&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=f880c51658ff4a3f9c1dfd22e8bf999a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:04.131979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e51a-b035-4272-9821-e6a7b5dad843 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:04.171521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:04.172149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:04.172430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:04.172703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:04.173355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:04.173653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:04.175111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:04.181071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 491/986] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:36:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:04.187127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:04.298816 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcdf5a-c55a-4efe-a285-dedf50899319 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:04.333340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:04.334058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:04.334279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:04.334476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:04.335154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:04.335453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:04.336942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:04.342199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 496/987] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:36:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:04.348349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:04.417432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:04.461670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc869-86c2-4684-90b1-c9f73427d26e None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:04.517252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:04.518273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:04.518799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:04.519265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:04.520577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] RBAC: Adding query filter params (interface=admin, service_id=dfe285b5ffc941da955c3c82c31e6c9b, region_id=RegionOne) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:04.521163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:04.523678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837a6a-e9f6-4b9a-b14d-0b4f8d9383b9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:04.537675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 492/988] 10.222.0.49 () {56 vars in 1249 bytes} [Tue Sep 6 11:36:04 2022] GET /identity/v3/endpoints?service_id=dfe285b5ffc941da955c3c82c31e6c9b&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:04.540228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:04.604307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:04.648761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de3b1b-f762-440d-ae0f-688306b65ed1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:04.685007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996cdfc-9c5f-4d6b-9a49-87af9a80875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:04.685617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996cdfc-9c5f-4d6b-9a49-87af9a80875a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:04.685889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996cdfc-9c5f-4d6b-9a49-87af9a80875a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:04.686155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996cdfc-9c5f-4d6b-9a49-87af9a80875a None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:04.686780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996cdfc-9c5f-4d6b-9a49-87af9a80875a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:04.688143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996cdfc-9c5f-4d6b-9a49-87af9a80875a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:04.695033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 497/989] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:36:04 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:36:05.828684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a119934-9bff-4f09-9bde-e1be60b6936c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:05.829267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a119934-9bff-4f09-9bde-e1be60b6936c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:05.829267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a119934-9bff-4f09-9bde-e1be60b6936c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:05.830599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 493/990] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:05.835939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27466-588d-421b-8e6a-35389ab068c5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:05.836383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27466-588d-421b-8e6a-35389ab068c5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:05.836486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27466-588d-421b-8e6a-35389ab068c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:05.855756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-7fb27466-588d-421b-8e6a-35389ab068c5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:05.856913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7fb27466-588d-421b-8e6a-35389ab068c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:05.926778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 498/991] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:06.014366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c8a1-5442-4434-ba88-bd90ed72ae86 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.014575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c8a1-5442-4434-ba88-bd90ed72ae86 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.014850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c8a1-5442-4434-ba88-bd90ed72ae86 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.016389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 494/992] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:06.021676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.021926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.022233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.041340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:06.042529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:06.092022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:06.114986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 499/993] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:06.188568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c8a1-5442-4434-ba88-bd90ed72ae86 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.300797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c8a1-5442-4434-ba88-bd90ed72ae86 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.327523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:06.337323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.337956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.338229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.338493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.339119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.340597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:06.350312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:06.356706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:06.357706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 495/994] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:06.363805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.379900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.473248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576e97-8c7e-49ae-ba1b-b7648284303d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.490742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833009-660b-4404-a792-ea38267c83f6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.511811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.512683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.513101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.513509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.514314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:06.514889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.516253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.527805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 500/995] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:06.529538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.531389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.532037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.532390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.532570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.533177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.534677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:06.543995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:06.545088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:06.545941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 496/996] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:06.551235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.589500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:06.611472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:06.643578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e6dc-6057-4870-a611-088978cf74c1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.657900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12c47-2f21-4b87-83c7-5eff554810c4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.680035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.680647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.680922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.681186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.681817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:06.682121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.683549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060ef7c-97cf-418c-a578-32cb9785c634 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.688610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 501/997] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:06.694143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a41978-254e-4f64-a7cd-ef22fbfe862f None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.694411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a41978-254e-4f64-a7cd-ef22fbfe862f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.694705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a41978-254e-4f64-a7cd-ef22fbfe862f None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.696106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 502/998] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:06.696658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a41978-254e-4f64-a7cd-ef22fbfe862f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.705710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.706325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.706617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.706914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.707550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] RBAC: Adding query filter params (name=image) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:06.707849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.709251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0d090-1168-4abe-b156-842150aa36d5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.718145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 497/999] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:06.719429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.719689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.719990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.738450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:06.739801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:06.806403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 498/1000] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:06.807207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.819734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a41978-254e-4f64-a7cd-ef22fbfe862f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.831098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:06.856685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.857369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.857666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.857821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.858556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] RBAC: Adding query filter params (interface=public, service_id=83aaa86e53b94e26a660430960093fc8, region_id=RegionOne) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:06.859155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.860252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.863185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:06.871665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 503/1001] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/endpoints?service_id=83aaa86e53b94e26a660430960093fc8&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:06.873492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.924391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952e8d9-1136-453e-8e94-6dc25af069a4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.960099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.961078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.961538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.961981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.962945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] RBAC: Adding query filter params (type=image) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:06.963440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.965028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.971014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 499/1002] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:06.985638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebcfd6-6044-4b07-8a21-2d05c8b990bb None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:07.037925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:07.038994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:07.039500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:07.039949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:07.042265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:07.044096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:07.052471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 504/1003] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:36:07.070479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:07.189630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e82f1-7912-4eb0-8931-debad8dfad4f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:07.205336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:07.226942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:07.227586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:07.227862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:07.228128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:07.228709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:07.230083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:07.239105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:07.240254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:07.241145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 500/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 6 11:36:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:07.246349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:07.287006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:07.347148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15b54-9ba3-407b-9a47-d644d3657d18 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:07.381195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:07.381772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:07.382022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:07.382314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:07.382971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:07.383246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:07.384644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:07.394288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 505/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:36:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:07.400218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:07.509597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b450b3-595a-4e34-a22d-97bad400bbf3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:07.544645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:07.545243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:07.545510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:07.545779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:07.546409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:07.546725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:07.548115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467e3f0-836d-435d-9e9f-2085b9093cc9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:07.554834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 501/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Sep 6 11:36:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:07.559024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:07.661271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82969c-1cf5-4785-bcbe-952b50286df5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:07.662935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:07.697788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c97982-bc70-457f-9d05-77636ab90ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:07.698394 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c97982-bc70-457f-9d05-77636ab90ea7 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:07.698650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c97982-bc70-457f-9d05-77636ab90ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:07.698966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c97982-bc70-457f-9d05-77636ab90ea7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:07.699626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c97982-bc70-457f-9d05-77636ab90ea7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:07.700988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c97982-bc70-457f-9d05-77636ab90ea7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:07.722722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 506/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:36:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:08.911172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435318c-a64a-4b2d-8d0d-07e3c07e3ee2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:08.911805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435318c-a64a-4b2d-8d0d-07e3c07e3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:08.911914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435318c-a64a-4b2d-8d0d-07e3c07e3ee2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:08.913500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 502/1008] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:08.918648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:08.919083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:08.919248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:08.939276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:08.940491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:09.000790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035ad6-bdd0-4558-877c-c1f6e43cbee8 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.000980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035ad6-bdd0-4558-877c-c1f6e43cbee8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.001248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035ad6-bdd0-4558-877c-c1f6e43cbee8 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.002838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 503/1009] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:36:09.007700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.007987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.008255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.022570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 507/1010] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:09.027481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:09.028692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:09.065531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:09.100416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 504/1011] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:09.283140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:09.362982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:09.373472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:09.387817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ce66c-deba-45e2-ba83-f818c6fd27cd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:09.432086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:09.433049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.433445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.433895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.434794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:09.436650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:09.458737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 508/1012] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:36:09 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:09.480139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e375c4-eb68-40bc-8424-9e8cc350c0f8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:09.530576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:09.531266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.531542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.531808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.532397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:09.533864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-2fb5a738-dc5f-48d9-994f-fd453022ec4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:09.543959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:09.545576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 11:36:09.546428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:09.547935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 505/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:09.551433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:09.658937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d99e6-1cb7-4378-b250-68c40d3e2581 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.659228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d99e6-1cb7-4378-b250-68c40d3e2581 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.659509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d99e6-1cb7-4378-b250-68c40d3e2581 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.662886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 506/1014] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:09.663875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a6698-b8af-4aeb-8221-fab400ae8d48 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:09.666359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.666641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.666947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.685770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:09.686997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:09.706355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:09.707004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.707282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.707552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.708230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:09.708609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:09.710755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:09.719101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 509/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:36:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:09.721808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:09.728256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:09.738644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:09.778993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 507/1016] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:09.836255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a8d87-f0c0-4ebf-b4b2-5235adb7aab4 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:09.870296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:09.870936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:09.871210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:09.871471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:09.872094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:09.872388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:09.873733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:09.878886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 510/1017] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 6 11:36:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:09.884793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:09.988456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c046b9-3c35-40a3-ade6-eb7199bd0819 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:10.024299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:10.024906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:10.025192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:10.025457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:10.026132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:10.027547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:10.054720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 508/1018] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:36:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:36:10.054979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:10.149448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:10.178352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740447a9-e676-4224-ad3a-af13144421e0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:10.224717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaa07a-7d0d-4c58-a696-29d9f9a8582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:10.225402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaa07a-7d0d-4c58-a696-29d9f9a8582a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:10.225689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaa07a-7d0d-4c58-a696-29d9f9a8582a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:10.225960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaa07a-7d0d-4c58-a696-29d9f9a8582a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:10.227136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaa07a-7d0d-4c58-a696-29d9f9a8582a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:10.228580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaa07a-7d0d-4c58-a696-29d9f9a8582a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:10.230533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 511/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:10.236755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:10.257951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:10.344118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8817fb-bb3d-4dcb-9f28-ff5d98cb8062 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:10.393814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce0931-9722-4653-b857-16d5073d3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:10.394456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0931-9722-4653-b857-16d5073d3a97 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:10.394715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0931-9722-4653-b857-16d5073d3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:10.395023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0931-9722-4653-b857-16d5073d3a97 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:10.395657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce0931-9722-4653-b857-16d5073d3a97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:10.397131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce0931-9722-4653-b857-16d5073d3a97 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:10.438709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 509/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:36:10 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:11.405806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29db44-b9b1-4183-992f-789cc4b1f69f None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:11.406372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29db44-b9b1-4183-992f-789cc4b1f69f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:11.406372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29db44-b9b1-4183-992f-789cc4b1f69f None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:11.407993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 512/1021] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:11.413740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:11.414261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:11.414261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:11.433402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:11.434722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:11.503305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:11.514881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 510/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:11.792061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29db44-b9b1-4183-992f-789cc4b1f69f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:11.910656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29db44-b9b1-4183-992f-789cc4b1f69f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:11.947355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:11.948001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:11.948284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:11.948563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] PATH_INFO: `/v3/services/image` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:11.949225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:11.950631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:11.959658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:11.960676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:11.961575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 513/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Sep 6 11:36:11 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:11.969062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.069290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a6e7c-35ab-4b31-a851-b4638e163ddf None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.105268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.105884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.106160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.106413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.107075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] RBAC: Adding query filter params (name=image) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:12.107373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:12.108735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fa37d-d5ef-45d2-9a5a-972aa51eb51a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:12.113776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 511/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:12.119564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.123410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:12.137176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653d78-c9f3-4ca0-b379-1acc58197f61 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.137453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653d78-c9f3-4ca0-b379-1acc58197f61 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.137730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653d78-c9f3-4ca0-b379-1acc58197f61 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.139263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 512/1025] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:36:12.143908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.144194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.144468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.163681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:12.165362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:12.225405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:12.230727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac948e49-4554-41c4-ab32-6878fd620b0d None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.235862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 513/1026] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:12.266885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.267502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.267781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.268049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.268677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] RBAC: Adding query filter params (type=image) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:12.269757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:12.271238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe2676-b1e4-41cf-98c0-2cca97b1acdb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:12.276536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 514/1027] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:12.283382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.387488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507380-e4cf-4dfa-b056-7d614697a401 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.390840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe99657-5207-41e9-a771-587e2522d817 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.391198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe99657-5207-41e9-a771-587e2522d817 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.391548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe99657-5207-41e9-a771-587e2522d817 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.393142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 515/1028] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:12.398217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.398505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.398812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.418033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:12.419278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:12.424561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.425187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.425466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.425734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.426432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] RBAC: Adding query filter params (interface=public, service_id=375c4d95853f4e7183884f628b299b1a, region_id=RegionOne) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:12.426769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:12.428201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:12.438034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 514/1029] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/endpoints?service_id=375c4d95853f4e7183884f628b299b1a&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:12.439472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.489507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:12.496987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 516/1030] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:12.506398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.509615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:12.555615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a45ba-2c02-4d33-8dfe-0678851d5987 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.589176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.589785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.590065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.590562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.590957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:12.592336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:12.606729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 515/1031] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:36:12.621967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9daad-b727-4443-8fe6-c1ca58504db4 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.664828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.665551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.665829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.666147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.678266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:12.683502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:12.684611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:12.687682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 517/1032] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:12.691020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.762125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.805944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d3b8-7724-46d4-b824-564a3620a5bb None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.834038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:12.837413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:12.849570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.850188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.850464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.850755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.851424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:12.851720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:12.853092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:12.861546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 516/1033] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:12.867518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.884179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145bdb1-53c7-435f-bbb5-b5274cf4ba6c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:12.919874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:12.920533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:12.920788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:12.921055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:12.922143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:12.923614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:12.925174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 518/1034] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:12.930830 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:12.977038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511ab45-1ff3-4ae1-9adc-fd5942435c25 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:13.012299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:13.012859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:13.013134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:13.013408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:13.024858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:13.026417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:13.030261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9fca1-79f8-4879-8aff-fb2313718b73 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:13.042461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:13.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:13.044429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:13.044429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:13.044429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:13.044429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 517/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:13.049719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:13.059547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:13.070365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:13.071161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:13.071438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:13.071709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:13.072367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:13.073805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:13.092431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:13.100408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 519/1036] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:36:12 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:36:13.165273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f6348-f68a-4134-ab6d-ba2301016cc7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:13.203190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:13.203824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:13.204149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:13.204421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:13.205059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:13.205380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:13.206921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:13.225054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 518/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:13.226524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:13.334398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d561e-d1e8-4454-82fd-a7fe2ee1d6e5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:13.368798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:13.369444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:13.369714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:13.369984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:13.377372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:13.378853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:36:13.389889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:13.391075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:13.392086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 520/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:36:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:13.399031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:13.500863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:13.509117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fcd40-2b3b-4ae5-8892-526a1b290be3 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:13.544866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:13.545486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:13.545765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:13.546003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:13.546741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:13.547072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:13.548493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:13.566885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 519/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:36:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:13.572831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:13.620200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:13.680022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef1c0c-7be8-4ba7-8b85-5174b2774826 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:13.721226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:13.721853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:13.722194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:13.722465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:13.794858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:13.796315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:13.838911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:13.902875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 521/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:13.908077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:14.013520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e10e5-a7b6-459e-a063-c85bfcc60315 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:14.048327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:14.048974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.049247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.049511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.059749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:14.061207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:14.076030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:14.077031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:14.077960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:14.077960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:14.077960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:14.077960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 520/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:14.084378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:14.187657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c96a-0091-40bf-bb57-fcb5e5423196 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:14.223094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:14.223757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.224088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.224357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.225028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:14.225334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:14.226820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:14.239696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 522/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:14.245436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:14.255282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:14.348251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d41f7-be28-4f8c-984c-94911fc7b0a8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:14.382284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:14.382955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.383233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.383508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.390367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:14.391853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7c85ca06-b470-4640-a272-8b7bc55f1376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:36:14.403051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:14.403939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:14.404858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:14.405887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 521/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:14.410064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:14.413253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:14.516110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2988a-3884-44d7-9c25-f7cf7cef1b31 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.516641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2988a-3884-44d7-9c25-f7cf7cef1b31 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.516641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2988a-3884-44d7-9c25-f7cf7cef1b31 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.517190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156da85-8cab-4c9c-877b-7c4c0d3dbd7a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:14.517927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 522/1044] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:14.523302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.523587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.523863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.543322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:14.544621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:14.555215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:14.555831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.556128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.556400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.557101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:14.557392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:14.558857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:14.576517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 523/1045] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:14.577561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:14.617624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:14.626768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 523/1046] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:14.650470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:14.689984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073b10-2e03-456e-a507-2ba88b860492 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:14.727918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:14.728536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:14.728811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:14.729082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:14.729809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] RBAC: Adding query filter params (role.id=f880c51658ff4a3f9c1dfd22e8bf999a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=a782787a64c94d0f8a43f7f8deeb120b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:14.730117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:14.731600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c46372-1c2c-482a-8109-b2f178c7119e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:14.742950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 524/1047] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:14 2022] GET /identity/v3/role_assignments?user.id=a782787a64c94d0f8a43f7f8deeb120b&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=f880c51658ff4a3f9c1dfd22e8bf999a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:14.897093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.001447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca702-f709-45f0-aa8b-e23ae8ca6f04 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.038369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.039041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.039314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.039581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] PATH_INFO: `/v3/services/image` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.040160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:15.041608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:15.042637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04628ea-a497-459d-9137-a0edee67c042 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.042961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04628ea-a497-459d-9137-a0edee67c042 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.043238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04628ea-a497-459d-9137-a0edee67c042 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.044590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 525/1048] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:15.049482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.049814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.050099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:15.052188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:15.053159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:15.054020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 524/1049] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Sep 6 11:36:14 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:15.059326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.072978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:15.074604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:15.127112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:15.151244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 526/1050] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:15.175631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7b51a-1744-4dc8-9014-5813b2a0ef93 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.213111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.213928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.214331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.214713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.215703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] RBAC: Adding query filter params (name=image) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:15.216006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:15.217392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:15.229004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 525/1051] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:15.231245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.291553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:15.337117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803029-61ab-4b83-b93e-2dacbabd2af1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.372078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.372690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.372965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.373237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.373866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] RBAC: Adding query filter params (type=image) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:15.374202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:15.375577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:15.380695 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 527/1052] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:15.386287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.419269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.489247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86469eb3-aa99-4e24-843c-e89f7f1dbb0f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.514716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:15.523254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3c3f-454d-4b66-9216-e9fd62705744 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.527867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.528492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.528769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.529037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.529721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:15.531608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:15.548961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:15.566714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 526/1053] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:36:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:36:15.571818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.572535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.572833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.573077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.585882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:15.590902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:15.591872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:15.592738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:15.595036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 528/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:15.598920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.715431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc69364-e8e8-4314-b193-f9e8d6d19bd0 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.753315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.753938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.754215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.754484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.755337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:15.755641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:15.757025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:15.767253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 527/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:15.773033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.878212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfd11b-6cfb-4c3e-8585-6f0d1efe50e5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:15.912395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:15.913020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:15.913294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:15.913558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] PATH_INFO: `/v3/users/2c7ccafefc7d4c1bbd5d04df5d94536c` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:15.927710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ccafefc7d4c1bbd5d04df5d94536c)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:15.929156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:15.931011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 529/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:15 2022] GET /identity/v3/users/2c7ccafefc7d4c1bbd5d04df5d94536c => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:15.936777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:15.984350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:16.044789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0001b79-eccd-4a1a-a518-c27568e89fcc None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:16.080094 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:16.080689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:16.080964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:16.081247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:16.150052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:16.151541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:16.192763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:16.253651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 528/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:16.259865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:16.295542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:16.361289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a58f0-a537-41c3-b167-b78e1014f0f4 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:16.394659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20d952-cf18-49c4-81e3-d4753e444479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:16.395319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20d952-cf18-49c4-81e3-d4753e444479 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:16.395596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20d952-cf18-49c4-81e3-d4753e444479 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:16.395897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20d952-cf18-49c4-81e3-d4753e444479 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:16.397020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20d952-cf18-49c4-81e3-d4753e444479 None admin] RBAC: Authorizing `identity:get_project(project_id=cc7c191856f34b56afcde6e3b60c0393)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:16.398452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20d952-cf18-49c4-81e3-d4753e444479 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:16.400311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 530/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:16 2022] GET /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:16.406248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:16.507000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50934-4ff3-4375-8df2-6cef4461e101 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:16.543320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:16.544022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:16.544248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:16.544427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:16.545151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=cc7c191856f34b56afcde6e3b60c0393, user.id=2c7ccafefc7d4c1bbd5d04df5d94536c) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:16.545453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:16.546923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585889b-6803-4bef-bf49-853e38688cb4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:16.552694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 529/1059] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:16 2022] GET /identity/v3/role_assignments?user.id=2c7ccafefc7d4c1bbd5d04df5d94536c&scope.project.id=cc7c191856f34b56afcde6e3b60c0393&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:16.617898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af76dc-e8ca-4060-870d-4712801a272c None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:16.618458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af76dc-e8ca-4060-870d-4712801a272c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:16.618458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af76dc-e8ca-4060-870d-4712801a272c None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:16.620011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 531/1060] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:16.625931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:16.626189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:16.626454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:16.640758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:16.648089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:16.649322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:16.734775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 530/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:16.996443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af76dc-e8ca-4060-870d-4712801a272c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.105776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af76dc-e8ca-4060-870d-4712801a272c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:17.107330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:17.141842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:17.142478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.142781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.143052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.153133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:17.157906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:17.162899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:17.164024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 532/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Sep 6 11:36:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:17.165281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.268307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f03ea-81f3-4956-8524-1efc502299ea None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:17.302536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:17.303166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.303442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.303711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.304374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:17.304668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:17.306044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:17.308276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:17.316126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 531/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:36:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:17.321708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.423260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8bef-4d87-41a1-b56a-3646a57b32be None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:17.458068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:17.458815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.459093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.459365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.469599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:17.471453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-82817ca5-abb0-4612-b87f-54bb3a29f1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:17.486192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:17.492334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:17.493266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:17.493266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:17.493266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:17.493266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 533/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:17.493496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.523232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca687c2-d7be-4609-8ad1-0bf4f520dd79 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.523413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca687c2-d7be-4609-8ad1-0bf4f520dd79 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.523697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca687c2-d7be-4609-8ad1-0bf4f520dd79 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.525175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 534/1065] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:36:17.530095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.530378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.530651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.548934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:17.550119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:17.560740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:17.602543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3747b-7d7b-4832-9253-78ae5b959d45 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:17.624047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 535/1066] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:17.639506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:17.640149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.640406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.640676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.641320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:17.641621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:17.643055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:17.655210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 532/1067] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:17.660755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.767395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441d71d-f288-48c9-9962-0252df4a7e86 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:17.803254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:17.803827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.804082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.804363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.811552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:17.813043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:36:17.824801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:17.825763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:36:17.826823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:17.830768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 536/1068] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:17.832003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.891778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:17.895828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:17.898143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:17.946286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437720fa-d07f-48ea-a103-c579a93270fe None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:17.982210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:17.982861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:17.983146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:17.983418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:17.984157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:17.984467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:17.985913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.000181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3596c-5937-4209-ad7d-a5477bf07e60 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.004134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 533/1069] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:18.009693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.037490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.038120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.038398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.038673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.110445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.111911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.115658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:18.124069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305088-ffad-4161-9af2-ec73e1fcced2 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.141926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:18.161953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.162587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.162900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.163172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.173910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.175407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:18.190342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:18.191449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:18.192343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:18.192343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:18.192343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:18.192343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 534/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:18.197666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.226527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 537/1071] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:18.233024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.319061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817aedd-4037-4bda-a0c4-7b31093fb7df None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.339382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786776-c04b-4dbf-8a6a-7bcf519bdbdd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.342917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:18.356917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.357510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.357790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.358081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.358745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:18.359048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.360960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.374055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 535/1072] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:18.378834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.379493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.379774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.380077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.380351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.390573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.392071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:18.406849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:18.407977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:18.408869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:18.408869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:18.408869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:18.408869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 538/1073] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:18.413863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.415706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:18.488433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18430bcc-3bce-41e8-a927-17dc49f5fa56 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.512621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a6dd0-64f2-4871-8516-62e0d074a070 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.528105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.528753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.529029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.529277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.537146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.538590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.549918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5d19ea87-d0c8-4b39-8467-32193858e78d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:36:18.550295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:18.551246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:18.552216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:18.552660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.552660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.552660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.552851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 536/1074] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:18.552930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:18.552930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.553057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96894478-4725-4082-b6e8-293b76644975 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.553057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96894478-4725-4082-b6e8-293b76644975 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.553500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96894478-4725-4082-b6e8-293b76644975 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.553591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dcb8b-9883-441a-be44-6220567414e5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.554713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 537/1075] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:18.557332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96894478-4725-4082-b6e8-293b76644975 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.570504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 539/1076] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:18.571763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.572043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.572309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.600114 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:18.601350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:18.615230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:18.667013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:18.676764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 540/1077] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:18.692375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96894478-4725-4082-b6e8-293b76644975 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.735552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.736176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.736423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.736687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.737386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:18.737686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.739249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.752380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 538/1078] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:18.758733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:18.863137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff522ae0-ec41-42e2-b2de-bd3e5d2150e0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:18.899161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:18.899753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:18.900063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:18.900329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/a782787a64c94d0f8a43f7f8deeb120b/roles/f880c51658ff4a3f9c1dfd22e8bf999a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:18.902515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=a782787a64c94d0f8a43f7f8deeb120b, role_id=f880c51658ff4a3f9c1dfd22e8bf999a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:18.903978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:18.917116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 541/1079] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:36:18 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/a782787a64c94d0f8a43f7f8deeb120b/roles/f880c51658ff4a3f9c1dfd22e8bf999a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:18.945297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:19.051281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceec194-53ca-49c2-9115-71e088de32e9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:19.087985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:19.088623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:19.088902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:19.089173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:19.100532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:19.105300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:19.106421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:19.107708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 539/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:19.112524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:19.121851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:19.214028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2fce3-b308-4daf-b9cc-52cd2f7ce357 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:19.249089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:19.249694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:19.249935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:19.250223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:19.250909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:19.251211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:19.252578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:19.261509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 542/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:19.267372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:19.279511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:19.373503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625caef-ec0d-47f2-94c6-528ef3a4a1d9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:19.408593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:19.409223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:19.409506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:19.409770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] PATH_INFO: `/v3/users/2c7ccafefc7d4c1bbd5d04df5d94536c` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:19.410950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ccafefc7d4c1bbd5d04df5d94536c)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:19.412457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:19.414207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 540/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:19 2022] GET /identity/v3/users/2c7ccafefc7d4c1bbd5d04df5d94536c => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:19.420044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:19.491720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:19.525825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c41e-4930-423e-8599-629207db0d29 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:19.560818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff696b-ed67-4faa-ae9d-62ad7c1fbed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:19.561450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff696b-ed67-4faa-ae9d-62ad7c1fbed8 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:19.561729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff696b-ed67-4faa-ae9d-62ad7c1fbed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:19.561996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff696b-ed67-4faa-ae9d-62ad7c1fbed8 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:19.563178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff696b-ed67-4faa-ae9d-62ad7c1fbed8 None admin] RBAC: Authorizing `identity:get_project(project_id=cc7c191856f34b56afcde6e3b60c0393)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:19.564627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff696b-ed67-4faa-ae9d-62ad7c1fbed8 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:19.566273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 543/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:19 2022] GET /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:19.572713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:19.649997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:19.674420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102725-6b26-44e8-b3c8-abb6d1d4638a None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:19.708712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59990c3e-33ea-472a-9ede-296155f03595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:19.709373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59990c3e-33ea-472a-9ede-296155f03595 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:19.709614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59990c3e-33ea-472a-9ede-296155f03595 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:19.709921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59990c3e-33ea-472a-9ede-296155f03595 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393/users/2c7ccafefc7d4c1bbd5d04df5d94536c/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:19.711948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59990c3e-33ea-472a-9ede-296155f03595 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc7c191856f34b56afcde6e3b60c0393, user_id=2c7ccafefc7d4c1bbd5d04df5d94536c, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:19.713388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59990c3e-33ea-472a-9ede-296155f03595 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:19.727837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 541/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:36:19 2022] PUT /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393/users/2c7ccafefc7d4c1bbd5d04df5d94536c/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:20.804728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c51d-ed93-4a2f-a423-295a40b904ee None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:20.805343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c51d-ed93-4a2f-a423-295a40b904ee None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:20.805343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c51d-ed93-4a2f-a423-295a40b904ee None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:20.806616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 544/1085] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:20.811937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:20.812376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:20.812466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:20.831954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:20.833144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:20.901533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 542/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:21.168163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c51d-ed93-4a2f-a423-295a40b904ee None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:21.275776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c51d-ed93-4a2f-a423-295a40b904ee None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:21.310119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:21.310755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.311055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.311324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.314007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:21.322439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:21.327263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:21.328292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:21.329183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 545/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:21.334539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:21.400522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:21.436344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16a0df-33bf-4f54-b27b-b2d7bd777a66 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:21.469846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:21.470831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.471107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.471377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.472035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:21.472336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:21.473716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fea75-68d1-4389-9026-6b6da003246d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:21.481842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 543/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:21.487752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:21.584302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a9e3-7ddb-4166-90f4-555c62a02078 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.584584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a9e3-7ddb-4166-90f4-555c62a02078 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.584859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a9e3-7ddb-4166-90f4-555c62a02078 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.586226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 544/1089] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:21.591301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.591585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.591859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.593619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc9653-25d9-4d98-8ebe-ca8961c991f0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:21.611619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:21.612820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:21.628083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:21.628725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.629002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.629271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.639492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:21.640945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:21.655751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:21.656785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:21.657858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:21.657858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:21.657858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:21.658478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 546/1090] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:21.662714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:21.682048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 545/1091] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:21.709852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:21.765617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cb5eb-f7ac-488c-85e8-7b5ae955ac2d None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:21.798450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:21.799091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.799372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.799644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.800285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:21.800585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:21.801976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:21.813680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 547/1092] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:21.819866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:21.881724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:21.925411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953cbe0-f067-4e37-a360-1dca9c982109 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:21.943921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:21.961229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:21.961788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:21.962061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:21.962315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:21.969585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:21.971429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:36:21.983675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:21.984764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:21.986241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 546/1093] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:21.991980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.047704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df823-d408-4b13-997c-494d390dad43 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.057595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.082796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.083509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.083788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.084062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.090715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf0c9-1f48-49e0-8d1f-92d9e1170703 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.094457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:22.099701 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:22.100642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:22.101496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 548/1094] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:22.106966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.108608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.125856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.126522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.126839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.127115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.127842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:22.128145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.129613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.146980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 6 11:36:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:22.152804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.214285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571534c-6c4c-4063-920a-60770f508a43 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.249143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.249749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.250021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.250306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.250990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:22.251296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.252675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.252777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65350-6ac9-45e5-829d-e7220f90af84 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.265274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 549/1096] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:22.271217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.292789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.293414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.293692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.294183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.308610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.348104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.373216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.374679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.385746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0c1d-7db2-4aa0-85a2-3463dc40ddf0 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.420959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.421597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.421870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.422140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] PATH_INFO: `/v3/users/2c7ccafefc7d4c1bbd5d04df5d94536c` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.423321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ccafefc7d4c1bbd5d04df5d94536c)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.424746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.431351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 550/1097] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/users/2c7ccafefc7d4c1bbd5d04df5d94536c => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:22.432353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.474120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 548/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:22.479792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.527264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.531144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d6390-d02a-4a89-b58e-b94ce28a6187 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.554770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.565138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.565825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.566170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.566502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.577686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e23256-5e2c-49c1-9c97-e01640b36b5c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.611609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.612246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.612518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.612757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.624742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.626197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.631429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.632866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:22.640913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:22.641916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:36:22.642904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:22.642904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:36:22.642904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:22.642904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 549/1099] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:22.648169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.734734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.744360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 551/1100] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:22.745217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.752583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca701f-c75f-488b-a20b-0e4167042eb8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.778311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.787281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.787891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.788172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.788441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.789078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:22.789380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.790788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.802268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 550/1101] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:22.807945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.845042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75408c68-12d6-4b87-86a8-e84fdcb5db20 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.879224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.879929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.880293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.880566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.881700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] RBAC: Authorizing `identity:get_project(project_id=cc7c191856f34b56afcde6e3b60c0393)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.883166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.884785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 552/1102] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:22.890895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.905830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dae5ac-d9bb-47c6-a600-a9141edb9e5d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:22.939663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:22.940298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:22.940580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:22.940867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:22.947550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:22.949002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:22.956189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:36:22.961067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:22.961968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:36:22.963361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:22.966827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 551/1103] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:36:22.968055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:22.991611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895617-0157-4288-a45d-64811d8010c7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:23.016035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:23.024251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:23.024850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:23.025127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:23.025394 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:23.026120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=cc7c191856f34b56afcde6e3b60c0393, user.id=2c7ccafefc7d4c1bbd5d04df5d94536c) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:23.026431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:23.027920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:23.033533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 553/1104] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/role_assignments?user.id=2c7ccafefc7d4c1bbd5d04df5d94536c&scope.project.id=cc7c191856f34b56afcde6e3b60c0393&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:23.070338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8835-e8cd-4778-8058-5391e997f630 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:23.107825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:23.108453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:23.108758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:23.109026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:23.109733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:23.110040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:23.111550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f4bd7-9336-4093-a8d8-9ca5482b080e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:23.126380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 552/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:36:23.133060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:23.241745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4285a1-6459-41c6-a1b5-821ec8fc04db None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:23.270108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:23.276687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:23.277301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:23.277575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:23.277843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:23.278567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] RBAC: Adding query filter params (role.id=f880c51658ff4a3f9c1dfd22e8bf999a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=a782787a64c94d0f8a43f7f8deeb120b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:23.278905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:23.280352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612fa4e-f0ff-4129-ab62-544fa5edcce2 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:23.286239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 554/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:23 2022] GET /identity/v3/role_assignments?user.id=a782787a64c94d0f8a43f7f8deeb120b&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=f880c51658ff4a3f9c1dfd22e8bf999a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:24.950112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a33d4-7f22-42fc-b522-29ac60f06808 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:24.951100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a33d4-7f22-42fc-b522-29ac60f06808 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:24.951100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a33d4-7f22-42fc-b522-29ac60f06808 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:24.953258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 553/1107] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:24.959259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:24.959726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:24.959845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:24.979638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:24.980762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:25.052580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:25.321399 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a33d4-7f22-42fc-b522-29ac60f06808 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:25.448044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a33d4-7f22-42fc-b522-29ac60f06808 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:25.458169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:25.483574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08581799-ca71-4186-9b15-05d4fc91cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:25.484200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08581799-ca71-4186-9b15-05d4fc91cd4d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:25.484471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08581799-ca71-4186-9b15-05d4fc91cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:25.484735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08581799-ca71-4186-9b15-05d4fc91cd4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:25.485870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08581799-ca71-4186-9b15-05d4fc91cd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:25.487341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08581799-ca71-4186-9b15-05d4fc91cd4d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:25.488912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:25.495223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:25.594044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce97d08-3ca4-498b-945d-595be34f046f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:25.617054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:25.627848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa3ce1-0580-4459-8bd8-f0371b82c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:25.628465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3ce1-0580-4459-8bd8-f0371b82c5f7 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:25.628727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3ce1-0580-4459-8bd8-f0371b82c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:25.628988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3ce1-0580-4459-8bd8-f0371b82c5f7 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:25.629626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa3ce1-0580-4459-8bd8-f0371b82c5f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:25.631134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa3ce1-0580-4459-8bd8-f0371b82c5f7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:25.658942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:36:25 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:36:27.593613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1da5d-4156-49c2-b112-3a5368b826d2 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:27.594193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1da5d-4156-49c2-b112-3a5368b826d2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:27.594193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1da5d-4156-49c2-b112-3a5368b826d2 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:27.595922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 555/1111] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:27.602280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:27.603141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:27.603309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:27.633118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:27.634315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:27.703140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:27.977226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1da5d-4156-49c2-b112-3a5368b826d2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:28.094146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1da5d-4156-49c2-b112-3a5368b826d2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:28.132215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:28.132853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:28.133128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:28.133393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] PATH_INFO: `/v3/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:28.134860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] RBAC: Authorizing `identity:get_role(role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:28.136234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:28.137619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:27 2022] GET /identity/v3/roles/559beb10e54749d1b4ce94120725233a => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:28.143849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:28.244493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ccbc-ae3b-403a-9055-6fa2e13af9bd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:28.254936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:28.285560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:28.286190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:28.286462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:28.286765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] PATH_INFO: `/v3/users/9d884436f13d48dfae613a358a40ffa2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:28.300323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] RBAC: Authorizing `identity:get_user(user_id=9d884436f13d48dfae613a358a40ffa2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:28.301762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:28.303420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:28 2022] GET /identity/v3/users/9d884436f13d48dfae613a358a40ffa2 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:28.309466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:28.367255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:28.431729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583aa20-0e64-44d6-a56b-045ef189f8b8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:28.469306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:28.470116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:28.470862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:28.471203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:28.543956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:28.545338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:28.591675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:28.654702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:28.661237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:28.766006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de0281-4f83-4d69-a6b0-5041cb337e00 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:28.802041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a2e2-593e-44e1-95f4-b4a88cfea70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:28.802602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a2e2-593e-44e1-95f4-b4a88cfea70c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:28.802907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a2e2-593e-44e1-95f4-b4a88cfea70c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:28.803251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a2e2-593e-44e1-95f4-b4a88cfea70c None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:28.804423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50a2e2-593e-44e1-95f4-b4a88cfea70c None admin] RBAC: Authorizing `identity:get_project(project_id=cc7c191856f34b56afcde6e3b60c0393)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:28.805863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50a2e2-593e-44e1-95f4-b4a88cfea70c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:28.807533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:28 2022] GET /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:28.813978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:28.920760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac35d-4e30-4484-a3f0-1d2f888543e5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:28.955413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:28.956006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:28.956274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:28.956537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:28.957256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] RBAC: Adding query filter params (role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=cc7c191856f34b56afcde6e3b60c0393, user.id=9d884436f13d48dfae613a358a40ffa2) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:28.957560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:28.959022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18d89-959b-40e1-83c8-270c49ad91d5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:28.964440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:28 2022] GET /identity/v3/role_assignments?user.id=9d884436f13d48dfae613a358a40ffa2&scope.project.id=cc7c191856f34b56afcde6e3b60c0393&role.id=559beb10e54749d1b4ce94120725233a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:30.838202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58efc0-6493-4f4e-af3a-c967c999712c None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:30.838863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58efc0-6493-4f4e-af3a-c967c999712c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:30.838863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58efc0-6493-4f4e-af3a-c967c999712c None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:30.840118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:30.846834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:30.847623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:30.847758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:30.873349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:30.874800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:30.877781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:30.955293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:31.228323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58efc0-6493-4f4e-af3a-c967c999712c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:31.274043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:31.356326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58efc0-6493-4f4e-af3a-c967c999712c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:31.391891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:31.392513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:31.392789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:31.393063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] PATH_INFO: `/v3/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:31.394587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] RBAC: Authorizing `identity:get_role(role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:31.396008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:31.397346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:31 2022] GET /identity/v3/roles/559beb10e54749d1b4ce94120725233a => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:31.406838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:31.508439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464dd03-1f2b-4cc6-b581-092507243f36 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:31.544792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:31.545422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:31.545698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:31.545970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] PATH_INFO: `/v3/users/9d884436f13d48dfae613a358a40ffa2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:31.547169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] RBAC: Authorizing `identity:get_user(user_id=9d884436f13d48dfae613a358a40ffa2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:31.548615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:31.550233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:31 2022] GET /identity/v3/users/9d884436f13d48dfae613a358a40ffa2 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:31.556628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:31.667608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e7a94-a782-4b40-a332-763223fd6dcf None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:31.669958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:31.707006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865b923-d1ad-4c40-92f6-800ea18f9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:31.707627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865b923-d1ad-4c40-92f6-800ea18f9c39 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:31.707903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865b923-d1ad-4c40-92f6-800ea18f9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:31.708166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865b923-d1ad-4c40-92f6-800ea18f9c39 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:31.709340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865b923-d1ad-4c40-92f6-800ea18f9c39 None admin] RBAC: Authorizing `identity:get_project(project_id=cc7c191856f34b56afcde6e3b60c0393)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:31.710849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865b923-d1ad-4c40-92f6-800ea18f9c39 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:31.712451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:31 2022] GET /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:31.718548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:31.728711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:31.823982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cfc4b-a718-4e9e-8e4f-5c5ad4266097 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:31.858740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3a4f-04f1-4bdd-b181-6a0e60045e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:31.859353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3a4f-04f1-4bdd-b181-6a0e60045e70 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:31.859661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3a4f-04f1-4bdd-b181-6a0e60045e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:31.859924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3a4f-04f1-4bdd-b181-6a0e60045e70 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393/users/9d884436f13d48dfae613a358a40ffa2/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:31.862226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd3a4f-04f1-4bdd-b181-6a0e60045e70 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc7c191856f34b56afcde6e3b60c0393, user_id=9d884436f13d48dfae613a358a40ffa2, role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:31.863690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd3a4f-04f1-4bdd-b181-6a0e60045e70 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:31.883513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:36:31 2022] PUT /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393/users/9d884436f13d48dfae613a358a40ffa2/roles/559beb10e54749d1b4ce94120725233a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:33.742377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c400-d26f-4cbc-bb31-68110ee1cadd None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:33.742939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c400-d26f-4cbc-bb31-68110ee1cadd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:33.742939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c400-d26f-4cbc-bb31-68110ee1cadd None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:33.744291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:33.750611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:33.751111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:33.751212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:33.772149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:33.773335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:33.835178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:33.844517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:34.116757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c400-d26f-4cbc-bb31-68110ee1cadd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:34.234972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c400-d26f-4cbc-bb31-68110ee1cadd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:34.272859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:34.273490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:34.273765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:34.274034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] PATH_INFO: `/v3/roles/559beb10e54749d1b4ce94120725233a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:34.275524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] RBAC: Authorizing `identity:get_role(role_id=559beb10e54749d1b4ce94120725233a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:34.276907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:34.278202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:34 2022] GET /identity/v3/roles/559beb10e54749d1b4ce94120725233a => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:34.284387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:34.391414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3ac7-fc89-4460-b171-ed13428a4ac6 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:34.427008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:34.427626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:34.427901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:34.428167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] PATH_INFO: `/v3/users/9d884436f13d48dfae613a358a40ffa2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:34.429504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] RBAC: Authorizing `identity:get_user(user_id=9d884436f13d48dfae613a358a40ffa2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:34.430985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:34.432542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:34 2022] GET /identity/v3/users/9d884436f13d48dfae613a358a40ffa2 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:34.441686 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:34.487514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:34.556647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a408-1a5e-47e9-af2b-f636c8c16bee None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:34.593634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:34.594235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:34.594510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:34.594814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:34.665782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:34.667275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:34.707364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:34.776620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:34.783473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:34.855730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:34.894764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2695d5-2581-4c84-8b0e-4731e8feb8cd None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:34.940348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250346d2-2ae4-4a6c-926e-baf070ab9b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:34.940911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250346d2-2ae4-4a6c-926e-baf070ab9b52 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:34.941193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250346d2-2ae4-4a6c-926e-baf070ab9b52 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:34.941463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250346d2-2ae4-4a6c-926e-baf070ab9b52 None admin] PATH_INFO: `/v3/projects/cc7c191856f34b56afcde6e3b60c0393` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:34.942728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250346d2-2ae4-4a6c-926e-baf070ab9b52 None admin] RBAC: Authorizing `identity:get_project(project_id=cc7c191856f34b56afcde6e3b60c0393)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:34.944197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250346d2-2ae4-4a6c-926e-baf070ab9b52 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:34.945831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:34 2022] GET /identity/v3/projects/cc7c191856f34b56afcde6e3b60c0393 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:34.952287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:35.051319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b16e4-7818-4173-b70c-0bb18ee836ed None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:35.089116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:35.089714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:35.090017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:35.090286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:35.091046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] RBAC: Adding query filter params (role.id=559beb10e54749d1b4ce94120725233a, scope.project.id=cc7c191856f34b56afcde6e3b60c0393, user.id=9d884436f13d48dfae613a358a40ffa2) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:35.091354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:35.092786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc55f1d-2235-4458-a9b0-f5426e1a2c98 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:35.098932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:34 2022] GET /identity/v3/role_assignments?user.id=9d884436f13d48dfae613a358a40ffa2&scope.project.id=cc7c191856f34b56afcde6e3b60c0393&role.id=559beb10e54749d1b4ce94120725233a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:37.019660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba951f9-d102-462b-9f0f-23f0e3ffa0d3 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:37.020267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba951f9-d102-462b-9f0f-23f0e3ffa0d3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:37.020267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba951f9-d102-462b-9f0f-23f0e3ffa0d3 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:37.021465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:37.028104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:37.028848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:37.028985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:37.040792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:37.057116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:37.058329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:37.130901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:37.397697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba951f9-d102-462b-9f0f-23f0e3ffa0d3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:37.505546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba951f9-d102-462b-9f0f-23f0e3ffa0d3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:37.535496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:37.541575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb1acc-a860-4120-b0bd-9e1d2e7cfdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:37.542199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1acc-a860-4120-b0bd-9e1d2e7cfdd4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:37.542475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1acc-a860-4120-b0bd-9e1d2e7cfdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:37.542775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1acc-a860-4120-b0bd-9e1d2e7cfdd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:37.543914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb1acc-a860-4120-b0bd-9e1d2e7cfdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:37.545354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb1acc-a860-4120-b0bd-9e1d2e7cfdd4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:37.546946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:37.552909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:37.666291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0667f-30b9-4827-b1ca-3d3d62d1ff38 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:37.703626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45d588-339e-476c-9b8a-200be827e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:37.704236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45d588-339e-476c-9b8a-200be827e15c None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:37.704518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45d588-339e-476c-9b8a-200be827e15c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:37.704788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45d588-339e-476c-9b8a-200be827e15c None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:37.705433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45d588-339e-476c-9b8a-200be827e15c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:37.706910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45d588-339e-476c-9b8a-200be827e15c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:37.711801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:37.742475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:36:37 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:39.649417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c1306-05c9-4834-bb72-0231245f31c1 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:39.650046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c1306-05c9-4834-bb72-0231245f31c1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:39.650046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c1306-05c9-4834-bb72-0231245f31c1 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:39.651318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:39.657754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:39.658526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:39.658727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:39.679570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:39.680811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:39.755032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:40.021740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c1306-05c9-4834-bb72-0231245f31c1 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:40.140586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c1306-05c9-4834-bb72-0231245f31c1 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:40.175709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d703e2-7fe3-432e-aba3-0dcb77fd1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:40.176328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d703e2-7fe3-432e-aba3-0dcb77fd1408 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:40.176605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d703e2-7fe3-432e-aba3-0dcb77fd1408 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:40.176870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d703e2-7fe3-432e-aba3-0dcb77fd1408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:40.178017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d703e2-7fe3-432e-aba3-0dcb77fd1408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:40.179585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d703e2-7fe3-432e-aba3-0dcb77fd1408 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:40.181144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:40.187886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:40.303085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a651ec-5b66-4440-937b-420463ec3614 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:40.321990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:40.341524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb673ee-facd-4647-a36a-0f542b59dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:40.342137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb673ee-facd-4647-a36a-0f542b59dc1e None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:40.342416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb673ee-facd-4647-a36a-0f542b59dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:40.342702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb673ee-facd-4647-a36a-0f542b59dc1e None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:40.343375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb673ee-facd-4647-a36a-0f542b59dc1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:40.344832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb673ee-facd-4647-a36a-0f542b59dc1e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:40.368631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:36:40 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:42.296632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27672827-4fbe-42f1-97d1-4cf5c2b21a2a None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:42.297575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27672827-4fbe-42f1-97d1-4cf5c2b21a2a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:42.297575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27672827-4fbe-42f1-97d1-4cf5c2b21a2a None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:42.299739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:42.306240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:42.306735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:42.306846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:42.336054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:42.337256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:42.413184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:42.682528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27672827-4fbe-42f1-97d1-4cf5c2b21a2a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:42.761817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:42.797731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27672827-4fbe-42f1-97d1-4cf5c2b21a2a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:42.836008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:42.836629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:42.836872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:42.837158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:42.848704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:42.853491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:42.854595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:42.855644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:42.860915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:42.982894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd17b7-0eb1-4244-a47a-7eb89b69ea84 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:42.984471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:43.020791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:43.021399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:43.021675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:43.021937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:43.022661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:43.022999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:43.024359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:43.032922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:43.038968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:43.158741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4ed6-0af0-4340-b74a-c622f7c29265 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:43.185308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:43.193896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:43.194537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:43.194846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:43.195115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] PATH_INFO: `/v3/users/5b02d8c4a65b4b4bbf7ee82bc3cae688` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:43.209725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] RBAC: Authorizing `identity:get_user(user_id=5b02d8c4a65b4b4bbf7ee82bc3cae688)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:43.211205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:43.212781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:43 2022] GET /identity/v3/users/5b02d8c4a65b4b4bbf7ee82bc3cae688 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:43.218982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:43.320461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e74e-85d1-4df9-b702-f2b6293c7d3c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:43.354670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:43.355293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:43.355564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:43.355824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:43.388456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:43.431181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:43.432631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:43.545566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:43.551737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:43.677311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208cec1-dae2-498f-9ed1-a821c1321aab None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:43.715461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e353631-3730-4170-ae65-7d1878267ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:43.716402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353631-3730-4170-ae65-7d1878267ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:43.716755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353631-3730-4170-ae65-7d1878267ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:43.717123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353631-3730-4170-ae65-7d1878267ad5 None admin] PATH_INFO: `/v3/projects/3e7d6d53c7814dd08cca6daf41a33115` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:43.719069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e353631-3730-4170-ae65-7d1878267ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7d6d53c7814dd08cca6daf41a33115)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:43.721715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e353631-3730-4170-ae65-7d1878267ad5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:43.724296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:43 2022] GET /identity/v3/projects/3e7d6d53c7814dd08cca6daf41a33115 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:43.730833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:43.811200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:43.850200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2624-1d3d-46c6-9320-2b991c955cfb None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:43.885723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:43.886325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:43.886599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:43.886906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:43.887632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=3e7d6d53c7814dd08cca6daf41a33115, user.id=5b02d8c4a65b4b4bbf7ee82bc3cae688) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:43.887947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:43.889418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1ed0-d88e-4bb7-b591-d0d35e322d90 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:43.894938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:43 2022] GET /identity/v3/role_assignments?user.id=5b02d8c4a65b4b4bbf7ee82bc3cae688&scope.project.id=3e7d6d53c7814dd08cca6daf41a33115&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:45.764208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594c63-fa64-4203-b709-9e8d4dbf5d76 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:45.764774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594c63-fa64-4203-b709-9e8d4dbf5d76 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:45.764774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594c63-fa64-4203-b709-9e8d4dbf5d76 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:45.766826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:45.773012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:45.773454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:45.773562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:45.797699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:45.799013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:45.867250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:46.132892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594c63-fa64-4203-b709-9e8d4dbf5d76 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:46.194523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:46.251384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594c63-fa64-4203-b709-9e8d4dbf5d76 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:46.289512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:46.290139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:46.290416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:46.290707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:46.301560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:46.306352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:46.307527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:46.308552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:46.316020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:46.377604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:46.436607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874072d-f8d9-4e00-a6ba-cd0c52f42d94 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:46.474853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:46.475538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:46.475810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:46.476065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:46.476703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:46.476999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:46.478409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:46.486605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:46.492955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:46.595916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea167-fe79-4218-adae-5223e1b08002 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:46.610012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:46.634118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:46.634720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:46.635041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:46.635306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] PATH_INFO: `/v3/users/5b02d8c4a65b4b4bbf7ee82bc3cae688` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:46.636465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] RBAC: Authorizing `identity:get_user(user_id=5b02d8c4a65b4b4bbf7ee82bc3cae688)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:46.637914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:46.639513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:46 2022] GET /identity/v3/users/5b02d8c4a65b4b4bbf7ee82bc3cae688 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:46.645458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:46.752149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460c31-2750-4621-ba19-c64594f8fbb6 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:46.772939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:46.790594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd296c-91d8-4125-b767-64c06db68048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:46.791246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd296c-91d8-4125-b767-64c06db68048 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:46.791540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd296c-91d8-4125-b767-64c06db68048 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:46.791812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd296c-91d8-4125-b767-64c06db68048 None admin] PATH_INFO: `/v3/projects/3e7d6d53c7814dd08cca6daf41a33115` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:46.793127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd296c-91d8-4125-b767-64c06db68048 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7d6d53c7814dd08cca6daf41a33115)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:46.794804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd296c-91d8-4125-b767-64c06db68048 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:46.797458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:46 2022] GET /identity/v3/projects/3e7d6d53c7814dd08cca6daf41a33115 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:46.804431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:46.919611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb788-de8d-4a96-ae28-b666c08ea986 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:46.956380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cba47c-fd05-4a79-850a-90bb47f03696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:46.957042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cba47c-fd05-4a79-850a-90bb47f03696 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:46.957324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cba47c-fd05-4a79-850a-90bb47f03696 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:46.957598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cba47c-fd05-4a79-850a-90bb47f03696 None admin] PATH_INFO: `/v3/projects/3e7d6d53c7814dd08cca6daf41a33115/users/5b02d8c4a65b4b4bbf7ee82bc3cae688/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:46.959838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cba47c-fd05-4a79-850a-90bb47f03696 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e7d6d53c7814dd08cca6daf41a33115, user_id=5b02d8c4a65b4b4bbf7ee82bc3cae688, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:46.961299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cba47c-fd05-4a79-850a-90bb47f03696 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:46.977349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:36:46 2022] PUT /identity/v3/projects/3e7d6d53c7814dd08cca6daf41a33115/users/5b02d8c4a65b4b4bbf7ee82bc3cae688/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:48.840724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952d2f-8c21-432f-928b-b30d50f3d14a None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:48.841344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952d2f-8c21-432f-928b-b30d50f3d14a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:48.841344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952d2f-8c21-432f-928b-b30d50f3d14a None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:48.843381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:48.852640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:48.853079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:48.853196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:48.882356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:48.883571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:48.919659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:48.952858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:49.218066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952d2f-8c21-432f-928b-b30d50f3d14a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:49.334903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952d2f-8c21-432f-928b-b30d50f3d14a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:49.369992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:49.370613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:49.370929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:49.371199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:49.385522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:36:49.390350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:49.391495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:36:49.392342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:49.397543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:49.511773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24acf-5ebf-4441-bd6c-a43bc248eb9c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:49.547737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:49.548344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:49.548619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:49.548894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:49.549555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:49.549858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:49.551284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:49.559479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:49.566386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:49.634247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:49.689282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750af0-16b8-4d34-9d82-2387f9108961 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:49.735291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:49.736200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:49.736484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:49.736795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] PATH_INFO: `/v3/users/5b02d8c4a65b4b4bbf7ee82bc3cae688` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:49.738769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=5b02d8c4a65b4b4bbf7ee82bc3cae688)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:49.741176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:49.742770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:36:49 2022] GET /identity/v3/users/5b02d8c4a65b4b4bbf7ee82bc3cae688 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:49.749547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:49.797211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:49.873559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587f5cb-b78b-40dc-b1a1-132c1514aea6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:49.913314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:49.913914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:49.914189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:49.914454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:49.984845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:49.986300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:50.019601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:50.090329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 11:36:50.097847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:50.195614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff089c-2535-48d1-890c-4b2b306a3bd7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:50.211964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:50.231966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898b156-a7ab-4f04-84a3-6f7a947ae25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:50.232584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b156-a7ab-4f04-84a3-6f7a947ae25e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:50.232861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b156-a7ab-4f04-84a3-6f7a947ae25e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:50.233128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b156-a7ab-4f04-84a3-6f7a947ae25e None admin] PATH_INFO: `/v3/projects/3e7d6d53c7814dd08cca6daf41a33115` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:50.234366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898b156-a7ab-4f04-84a3-6f7a947ae25e None admin] RBAC: Authorizing `identity:get_project(project_id=3e7d6d53c7814dd08cca6daf41a33115)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:50.235837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898b156-a7ab-4f04-84a3-6f7a947ae25e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:50.237439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:36:50 2022] GET /identity/v3/projects/3e7d6d53c7814dd08cca6daf41a33115 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:50.244339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:50.352310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a71c-52f8-4a3c-939f-9c9bf1399a86 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:50.387386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:50.387975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:50.388250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:50.388516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:50.389254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=3e7d6d53c7814dd08cca6daf41a33115, user.id=5b02d8c4a65b4b4bbf7ee82bc3cae688) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:50.389560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:50.391027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ec16d-5910-4ced-9ed3-01d9bd14d9d5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:50.392850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:50.397390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:36:50 2022] GET /identity/v3/role_assignments?user.id=5b02d8c4a65b4b4bbf7ee82bc3cae688&scope.project.id=3e7d6d53c7814dd08cca6daf41a33115&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:52.290058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f28e2-bcfd-4196-9bf7-56c16d00ce32 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:52.290661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f28e2-bcfd-4196-9bf7-56c16d00ce32 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:52.290661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f28e2-bcfd-4196-9bf7-56c16d00ce32 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:52.291978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:52.298415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:52.299183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:52.299328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:52.325384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:52.326584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:52.396955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:52.660113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f28e2-bcfd-4196-9bf7-56c16d00ce32 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:52.769492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f28e2-bcfd-4196-9bf7-56c16d00ce32 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:52.805767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4262306-2816-4545-8171-058075b909c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:52.806365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4262306-2816-4545-8171-058075b909c1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:52.806637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4262306-2816-4545-8171-058075b909c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:52.806941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4262306-2816-4545-8171-058075b909c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:52.859100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:52.879086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4262306-2816-4545-8171-058075b909c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:52.880552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4262306-2816-4545-8171-058075b909c1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:52.980323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:36:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 11:36:52.989640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:53.092913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4232de8-0f77-4165-bee5-ccbb3fa7ac9e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:53.120031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:53.129366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:53.129995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:53.130270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:53.130538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:53.137462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:53.138940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-ef4e6551-cb7b-4877-9c8b-40ea6745761a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:36:53.150604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:36:53.151786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:36:53.152641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:36:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:36:53.157872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4262306-2816-4545-8171-058075b909c1 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:53.239626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:53.260815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4262306-2816-4545-8171-058075b909c1 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:53.295102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:53.295736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:53.295968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:53.296238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:53.296877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:53.297179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:53.298562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8437e2b-6075-4d19-9d9f-75134ec99618 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:53.306882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Sep 6 11:36:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:55.210734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c78928-7920-4984-a728-f04ee9284fd5 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:55.211753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c78928-7920-4984-a728-f04ee9284fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:55.211753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c78928-7920-4984-a728-f04ee9284fd5 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:55.213737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:55.222336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f1b-27c2-434e-91a2-8575934036ee None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:55.222827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f1b-27c2-434e-91a2-8575934036ee None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:55.222931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f1b-27c2-434e-91a2-8575934036ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:55.243291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-10738f1b-27c2-434e-91a2-8575934036ee None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:55.244482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-10738f1b-27c2-434e-91a2-8575934036ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:55.315583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:36:55.582004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c78928-7920-4984-a728-f04ee9284fd5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:55.709306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c78928-7920-4984-a728-f04ee9284fd5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:55.748526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b9ca9-525e-4be7-928a-7c07ed706ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:55.749136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b9ca9-525e-4be7-928a-7c07ed706ac7 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:55.749412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b9ca9-525e-4be7-928a-7c07ed706ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:55.749677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b9ca9-525e-4be7-928a-7c07ed706ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:55.750359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b9ca9-525e-4be7-928a-7c07ed706ac7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:55.751787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b9ca9-525e-4be7-928a-7c07ed706ac7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:55.771201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Tue Sep 6 11:36:55 2022] POST /identity/v3/domains => generated 267 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:57.692332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df54b4-9aea-459d-b6b7-6762986457d6 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:57.693259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df54b4-9aea-459d-b6b7-6762986457d6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:57.693259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df54b4-9aea-459d-b6b7-6762986457d6 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:57.695099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:36:57.700621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:57.701056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:57.701168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:57.722089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:57.723340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:57.769155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:57.800127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:36:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:36:58.065423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df54b4-9aea-459d-b6b7-6762986457d6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:58.156818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:58.181332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df54b4-9aea-459d-b6b7-6762986457d6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:58.216803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595942cd-0904-4c98-b7fe-e3678e206e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:58.217430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595942cd-0904-4c98-b7fe-e3678e206e12 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:58.217703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595942cd-0904-4c98-b7fe-e3678e206e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:58.217970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595942cd-0904-4c98-b7fe-e3678e206e12 None admin] PATH_INFO: `/v3/domains/729973922a6a4b82b4cee9a592046e45` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:58.229152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595942cd-0904-4c98-b7fe-e3678e206e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=729973922a6a4b82b4cee9a592046e45)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:58.230598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595942cd-0904-4c98-b7fe-e3678e206e12 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:58.232221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Sep 6 11:36:58 2022] GET /identity/v3/domains/729973922a6a4b82b4cee9a592046e45 => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:58.238475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:58.345425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355f15a-93c9-4381-8fa8-d224062228db None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:58.379244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3fd9-19c5-4bcd-a6fb-3ca56c828c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:58.379839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3fd9-19c5-4bcd-a6fb-3ca56c828c82 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:58.380109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3fd9-19c5-4bcd-a6fb-3ca56c828c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:58.380373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3fd9-19c5-4bcd-a6fb-3ca56c828c82 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:58.381018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f3fd9-19c5-4bcd-a6fb-3ca56c828c82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:58.382528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f3fd9-19c5-4bcd-a6fb-3ca56c828c82 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:58.415784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:36:58 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:37:00.352346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24624b7a-5e2b-470a-9253-ae7f81b99901 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:00.353237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24624b7a-5e2b-470a-9253-ae7f81b99901 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:00.353237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24624b7a-5e2b-470a-9253-ae7f81b99901 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:00.355405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:37:00.364442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:00.365229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:00.365384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:00.386708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:00.387937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:00.413129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:00.456369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:37:00.728866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24624b7a-5e2b-470a-9253-ae7f81b99901 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:00.835172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24624b7a-5e2b-470a-9253-ae7f81b99901 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:00.878676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e094-843f-4cca-baf2-71723acaeca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:00.879341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e094-843f-4cca-baf2-71723acaeca3 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:00.879617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e094-843f-4cca-baf2-71723acaeca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:00.879884 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e094-843f-4cca-baf2-71723acaeca3 None admin] PATH_INFO: `/v3/domains/729973922a6a4b82b4cee9a592046e45` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:00.881225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e094-843f-4cca-baf2-71723acaeca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=729973922a6a4b82b4cee9a592046e45)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:00.882735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e094-843f-4cca-baf2-71723acaeca3 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:00.884309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Sep 6 11:37:00 2022] GET /identity/v3/domains/729973922a6a4b82b4cee9a592046e45 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:00.893143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:00.996995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73414e-2a88-4e23-875c-99e9591c680a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:01.032148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44d491-7376-4120-ad54-89cf5db90d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:01.032747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d491-7376-4120-ad54-89cf5db90d4d None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:01.033026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d491-7376-4120-ad54-89cf5db90d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:01.033294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d491-7376-4120-ad54-89cf5db90d4d None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:01.033931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44d491-7376-4120-ad54-89cf5db90d4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:01.035415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44d491-7376-4120-ad54-89cf5db90d4d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:01.060602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:37:00 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:37:02.988776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102a946-13e5-43f5-9a61-977f0275d498 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:02.989642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102a946-13e5-43f5-9a61-977f0275d498 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:02.989642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102a946-13e5-43f5-9a61-977f0275d498 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:02.991791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:37:02.998027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:02.998494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:02.998595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:03.021061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:03.022244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:03.033163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:03.099556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:37:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:37:03.366083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102a946-13e5-43f5-9a61-977f0275d498 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:03.380949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:03.487658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102a946-13e5-43f5-9a61-977f0275d498 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:03.521767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:03.522422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:03.522791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:03.523045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:03.533931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:37:03.538742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:37:03.539899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:37:03.540853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:37:03.547637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:03.658166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2be99-3a88-47ae-a68f-cb4b23ac7f22 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:03.693361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:03.693954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:03.694225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:03.694547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:03.695234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:37:03.695534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:03.696910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:03.704983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:37:03.710770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:03.787927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:03.827506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2821cb-d58a-41aa-afff-9e62500c5343 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:03.870634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:03.871284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:03.871557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:03.871821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] PATH_INFO: `/v3/users/2f2364e507de4e5d94a54faf7a26566b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:03.885524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] RBAC: Authorizing `identity:get_user(user_id=2f2364e507de4e5d94a54faf7a26566b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:03.886989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:03.888583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:37:03 2022] GET /identity/v3/users/2f2364e507de4e5d94a54faf7a26566b => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:03.895021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:03.908262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:04.007585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6ccb-8128-4258-b112-740f2da0f23b None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:04.046912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:04.047516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:04.047793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:04.048058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:04.121931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:04.123438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:04.134272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:04.228221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:37:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:37:04.237157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:04.350357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc500-4606-47df-b28d-429795ea0887 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:04.374141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:04.387135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f044-16c7-4280-8693-a737ad2504fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:04.387772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f044-16c7-4280-8693-a737ad2504fe None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:04.388051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f044-16c7-4280-8693-a737ad2504fe None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:04.388321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f044-16c7-4280-8693-a737ad2504fe None admin] PATH_INFO: `/v3/projects/dd6f22727bb5416baabb515e5835e588` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:04.389504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f044-16c7-4280-8693-a737ad2504fe None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f22727bb5416baabb515e5835e588)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:04.390991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f044-16c7-4280-8693-a737ad2504fe None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:04.392672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:37:04 2022] GET /identity/v3/projects/dd6f22727bb5416baabb515e5835e588 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:04.399069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:04.507115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40887-4544-41da-a2ac-926be86d65ee None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:04.516198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:04.542513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:04.543150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:04.543425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:04.543691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:04.544419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=dd6f22727bb5416baabb515e5835e588, user.id=2f2364e507de4e5d94a54faf7a26566b) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:37:04.544730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:04.546177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745837e-48f1-4512-86f9-781a4fcbc61e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:04.551712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:37:04 2022] GET /identity/v3/role_assignments?user.id=2f2364e507de4e5d94a54faf7a26566b&scope.project.id=dd6f22727bb5416baabb515e5835e588&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:06.427869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f51e4-1805-42cd-bb97-18cef4e062de None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:06.428457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f51e4-1805-42cd-bb97-18cef4e062de None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:06.428457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f51e4-1805-42cd-bb97-18cef4e062de None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:06.429839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:37:06.436005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:06.440727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:06.440727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:06.464935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:06.466148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:06.545203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:37:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:37:06.826627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f51e4-1805-42cd-bb97-18cef4e062de None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:06.967008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f51e4-1805-42cd-bb97-18cef4e062de None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:07.003460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:07.004083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:07.004362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:07.004630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:07.015661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:37:07.020502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:37:07.021567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:37:07.022420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:37:07.027794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:07.133333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704d4a-73c2-4d56-9ae4-dea502aeb43d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:07.134895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:07.169666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:07.170265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:07.170539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:07.170832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:07.171509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:37:07.171802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:07.173167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:07.181185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:07.189964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:07.249237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:07.298069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebf280-3cae-421d-811c-79ef8f889a24 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:07.333333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:07.333938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:07.334209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:07.334472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] PATH_INFO: `/v3/users/2f2364e507de4e5d94a54faf7a26566b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:07.335769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] RBAC: Authorizing `identity:get_user(user_id=2f2364e507de4e5d94a54faf7a26566b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:07.337200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:07.338735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:37:07 2022] GET /identity/v3/users/2f2364e507de4e5d94a54faf7a26566b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:07.345145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:07.447079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede51376-c28b-448a-80f7-b91a0ad03f36 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:07.482605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69dda8-db89-486f-8368-7c993692ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:07.483258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dda8-db89-486f-8368-7c993692ca33 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:07.483517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dda8-db89-486f-8368-7c993692ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:07.483795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dda8-db89-486f-8368-7c993692ca33 None admin] PATH_INFO: `/v3/projects/dd6f22727bb5416baabb515e5835e588` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:07.484947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69dda8-db89-486f-8368-7c993692ca33 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f22727bb5416baabb515e5835e588)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:07.486393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69dda8-db89-486f-8368-7c993692ca33 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:07.488049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:37:07 2022] GET /identity/v3/projects/dd6f22727bb5416baabb515e5835e588 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:07.494154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:07.599127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad127-23a6-423f-b41a-072b323bd439 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:07.618981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:07.635138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e2608-4281-48b8-948f-6a733e890115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:07.635790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e2608-4281-48b8-948f-6a733e890115 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:07.636064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e2608-4281-48b8-948f-6a733e890115 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:07.636332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e2608-4281-48b8-948f-6a733e890115 None admin] PATH_INFO: `/v3/projects/dd6f22727bb5416baabb515e5835e588/users/2f2364e507de4e5d94a54faf7a26566b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:07.638334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e2608-4281-48b8-948f-6a733e890115 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f22727bb5416baabb515e5835e588, user_id=2f2364e507de4e5d94a54faf7a26566b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:07.639792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e2608-4281-48b8-948f-6a733e890115 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:07.654458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:37:07 2022] PUT /identity/v3/projects/dd6f22727bb5416baabb515e5835e588/users/2f2364e507de4e5d94a54faf7a26566b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:37:09.560246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e653f7d-102f-419c-a7f1-afbf2fe08cb1 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:09.561144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e653f7d-102f-419c-a7f1-afbf2fe08cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:09.561144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e653f7d-102f-419c-a7f1-afbf2fe08cb1 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:09.563400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:37:09.569660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:09.570198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:09.570307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:09.600089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:09.601844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:09.683827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:37:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:37:09.956822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e653f7d-102f-419c-a7f1-afbf2fe08cb1 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:09.994444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:10.068370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e653f7d-102f-419c-a7f1-afbf2fe08cb1 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:10.103691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:10.104314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:10.104587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:10.104855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:10.115721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:37:10.121084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:37:10.122152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:37:10.123062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:37:10.131303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:10.242991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3e48-eb2b-40c8-be40-4d8def0d0da3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:10.253483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:10.279897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:10.280507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:10.280786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:10.281057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:10.281720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:37:10.282022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:10.283412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:10.291568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:10.297827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:10.408320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:10.418715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235fb2-1eca-4a9d-a36e-2416f7c46b38 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:10.473457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:10.474092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:10.474370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:10.474634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] PATH_INFO: `/v3/users/2f2364e507de4e5d94a54faf7a26566b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:10.475937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] RBAC: Authorizing `identity:get_user(user_id=2f2364e507de4e5d94a54faf7a26566b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:10.477468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:10.479093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 6 11:37:10 2022] GET /identity/v3/users/2f2364e507de4e5d94a54faf7a26566b => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:10.485954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:10.602886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa1f68-474f-4555-a1f2-02ff743bfd00 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:10.636775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:10.637361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:10.637632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:10.637895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:10.678427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:10.706097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:10.707637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:10.814945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:37:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:37:10.824661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:10.932433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e68c-9ce1-45f7-a06b-8dd83d40381c None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:10.966228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b931bf3-6d82-4be0-9b24-6e782f59e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:10.966879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b931bf3-6d82-4be0-9b24-6e782f59e333 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:10.967150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b931bf3-6d82-4be0-9b24-6e782f59e333 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:10.967418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b931bf3-6d82-4be0-9b24-6e782f59e333 None admin] PATH_INFO: `/v3/projects/dd6f22727bb5416baabb515e5835e588` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:10.968564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b931bf3-6d82-4be0-9b24-6e782f59e333 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6f22727bb5416baabb515e5835e588)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:10.969998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b931bf3-6d82-4be0-9b24-6e782f59e333 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:10.972002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 6 11:37:10 2022] GET /identity/v3/projects/dd6f22727bb5416baabb515e5835e588 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:10.979348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:11.053664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:11.090876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57157ab0-2ba9-40c7-9725-19fddb8a5f4e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:11.126233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:11.126861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:11.127136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:11.127399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:11.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=dd6f22727bb5416baabb515e5835e588, user.id=2f2364e507de4e5d94a54faf7a26566b) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:37:11.128424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:11.129872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4440-8670-47f2-a089-1fb8f5972b7a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:11.136058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:37:10 2022] GET /identity/v3/role_assignments?user.id=2f2364e507de4e5d94a54faf7a26566b&scope.project.id=dd6f22727bb5416baabb515e5835e588&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:37:20.961555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=86 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:21.133534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=32 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:06.304551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef18a68-0e3e-4a80-8d7c-6ddb4608b083 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:06.305176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef18a68-0e3e-4a80-8d7c-6ddb4608b083 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:06.305176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef18a68-0e3e-4a80-8d7c-6ddb4608b083 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:06.306647 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:06.313174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:06.313649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:06.313740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:06.333111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:06.334316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:06.413284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:06.735923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef18a68-0e3e-4a80-8d7c-6ddb4608b083 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:06.892793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef18a68-0e3e-4a80-8d7c-6ddb4608b083 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:06.939383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:06.940046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:06.940323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:06.940587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:06.951777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:06.953244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:06.971162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:06.975361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:06.976489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:06.976489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:06.976489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:06.976489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:06.980262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:07.101610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd918352-4050-41a1-9ebe-d44ccb952b91 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:07.135080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:07.142018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:07.142747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:07.143050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:07.143552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:07.144253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:07.144551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:07.146573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834bc5-c999-4508-9b4c-b2630209e97d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:07.160460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:07.167386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:07.233788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:07.304359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefbc4-5b85-441a-9620-c2956cb607ab None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:07.345908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54892a-421e-42a9-b213-ea4adc8bcdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:07.346833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54892a-421e-42a9-b213-ea4adc8bcdb8 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:07.346989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54892a-421e-42a9-b213-ea4adc8bcdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:07.347591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54892a-421e-42a9-b213-ea4adc8bcdb8 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:07.348529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54892a-421e-42a9-b213-ea4adc8bcdb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:07.350271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54892a-421e-42a9-b213-ea4adc8bcdb8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:07.377375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 6 11:38:07 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:38:09.696862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eb023-f531-49fc-a39b-3329267821d6 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:09.697483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eb023-f531-49fc-a39b-3329267821d6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:09.697483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eb023-f531-49fc-a39b-3329267821d6 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:09.698917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:09.705669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:09.706191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:09.706456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:09.728326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:09.729900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:09.809788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:10.124514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eb023-f531-49fc-a39b-3329267821d6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:10.234894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eb023-f531-49fc-a39b-3329267821d6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:10.275719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:10.276700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:10.277059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:10.277406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:10.291109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:38:10.297082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:10.298222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:10.299199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:10.306135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:10.363225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:10.448304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a3c5a-cf6b-493e-ba8e-c10e2f516839 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:10.490467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:10.491117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:10.491379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:10.491649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:10.492325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:10.492627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:10.494016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:10.503404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:10.510792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:10.572060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:10.633970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3d46-fd40-4f80-9fdf-7e7aa3992a80 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:10.679137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:10.679918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:10.680217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:10.680442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:10.697768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:10.699493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:10.716670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:10.717861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:10.718835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:10.718835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:10.718835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:10.718835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:10.724327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:10.848402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:10.852272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90270-b7e2-4582-8e5f-f3c4f76d0b25 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:10.893443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:10.897485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:10.897485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:10.897485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:10.897485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:10.897485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:10.897485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:10.913355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:10.919970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:11.050761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10215bb-9346-4166-aa7e-84eb0a9037ce None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:11.052616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:11.091399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:11.092128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:11.092548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:11.092836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:11.103994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:11.105952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:38:11.120148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:11.128888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:11.130033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:11.130723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:11.246808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5905c-08de-433a-acec-765ff92376e9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:11.287946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:11.288747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:11.289054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:11.289408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:11.290376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:11.290703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:11.292131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:11.312939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 6 11:38:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:11.319932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:11.443344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42127d-319c-40d2-8c6d-3f04912b775a None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:11.482578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:11.485922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:11.485922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:11.485922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:11.517283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:11.557850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:11.559342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:11.678191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:38:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:38:11.684402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:11.706516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:11.807921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e9ba-b297-4607-9271-9f698a70a755 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:11.849184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:11.850134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:11.850572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:11.851028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:11.863963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:11.865669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:11.881614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:11.884384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:11.885299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:11.885299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:11.885299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:11.885299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:11.889108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:11.957051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:12.016748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e820fc-08b5-459d-85ee-ee145944a7dc None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:12.054947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:12.056015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:12.056322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:12.056783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:12.057545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:12.057927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:12.059560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:12.072397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:12.079388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:12.182848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:12.224378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007478b-52ae-4c1a-8277-eada44390d12 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:12.259784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:12.260439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:12.260715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:12.261022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:12.268320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:12.269893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:38:12.281985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:12.283075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:12.284145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:12.289269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:12.395782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5db68-3dd1-4d94-a469-495a06a98b5f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:12.419434 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:12.432900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:12.433573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:12.433881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:12.434181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:12.434947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:12.435287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:12.437034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9daada-7845-435a-9902-ff266f9b2de2 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:12.450387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:12.456695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:12.564808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7289e0-9ed0-49d9-94de-c68ad9559151 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:12.596049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:12.603224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:12.603839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:12.604143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:12.604416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:12.605154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=422e32cb1eb345899ec4f2283d5fe828) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:12.605481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:12.607173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ffdb-ee91-4c6e-a5c6-e0ed8a64488d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:12.613799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:38:12 2022] GET /identity/v3/role_assignments?user.id=422e32cb1eb345899ec4f2283d5fe828&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:14.506432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ef3d2-b3ab-45f0-94d6-2fd373d09afd None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:14.507043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ef3d2-b3ab-45f0-94d6-2fd373d09afd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:14.507043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ef3d2-b3ab-45f0-94d6-2fd373d09afd None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:14.508418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:14.513767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:14.514229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:14.514333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:14.536136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:14.537554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:14.617411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:14.900925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ef3d2-b3ab-45f0-94d6-2fd373d09afd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:15.014006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ef3d2-b3ab-45f0-94d6-2fd373d09afd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:15.056456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:15.057576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:15.058248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:15.058773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:15.070438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:38:15.075274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:15.077597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:15.078629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:15.083276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:15.208322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee1be-74ad-416e-be84-e93f7fff69d7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:15.233411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:15.244639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:15.245272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:15.245597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:15.245897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:15.246669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:15.247041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:15.248646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:15.257717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:15.263839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:15.312172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:15.376542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de086-8e11-4bb5-9c54-40c85b83283b None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:15.412241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:15.412922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:15.413221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:15.413463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:15.424295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:15.425735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:15.440323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:15.441570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:15.442652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:15.442652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:15.442652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:15.442652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:15.447696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:15.554764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12baeecd-303f-4137-88a2-80cf56be51f5 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:15.588745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:15.589359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:15.589638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:15.589909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:15.590547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:15.590877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:15.592315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:15.604695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:15.610888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:15.707320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:15.714730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc82bb-b701-452a-b4c9-1f5f0609d1fd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:15.753689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:15.754343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:15.754634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:15.754968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:15.763342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:15.764749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:38:15.776083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:15.777289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:15.778497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:15.783956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:15.835634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:15.898386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e357f8-56b0-4a1c-9e7f-9b30eaaee0a9 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:15.933907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:15.934539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:15.934854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:15.935129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:15.936003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:15.936311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:15.937947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:15.956602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 6 11:38:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:15.962819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:16.079757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2006e-61e7-4d8a-a841-a23023c64192 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:16.124982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129133d-5351-417f-939b-d70307f74bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:16.125792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129133d-5351-417f-939b-d70307f74bce None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:16.126138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129133d-5351-417f-939b-d70307f74bce None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:16.126584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129133d-5351-417f-939b-d70307f74bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:16.139052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129133d-5351-417f-939b-d70307f74bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:16.140546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129133d-5351-417f-939b-d70307f74bce None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-2129133d-5351-417f-939b-d70307f74bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:16.155218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:16.156409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:16.157483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:16.157483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:16.157483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:16.157483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:16.162650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:16.274162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d01e-da47-4c91-b188-998ea6d19541 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:16.276650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:16.312068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:16.312732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:16.313182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:16.313536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:16.314453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:16.314856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:16.316789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:16.334114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:16.340319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129133d-5351-417f-939b-d70307f74bce None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:16.350553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:16.456327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129133d-5351-417f-939b-d70307f74bce None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:16.492596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:16.493227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:16.493497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:16.493764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:16.500784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:16.502241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:38:16.514636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:16.515803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:16.516933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:16.517883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:38:16.524141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:16.630058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191134-7e36-495e-aace-4aca325b3fa7 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:16.663322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:16.663904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:16.664220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:16.664461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:16.665133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:16.665434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:16.666925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a6169-6892-482c-a5b7-52a5e996b67e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:16.678971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:16.685239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:16.757753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:16.800159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c4129-8eb4-47aa-b9ec-91d2a0ce1aaa None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:16.840395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035eca-2c47-4be9-ace1-427a8c7f81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:16.841130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035eca-2c47-4be9-ace1-427a8c7f81f9 None admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:16.841472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035eca-2c47-4be9-ace1-427a8c7f81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:16.841880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035eca-2c47-4be9-ace1-427a8c7f81f9 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/422e32cb1eb345899ec4f2283d5fe828/roles/ae920144abd94ff6b057c1982924d801` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:16.860451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035eca-2c47-4be9-ace1-427a8c7f81f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=422e32cb1eb345899ec4f2283d5fe828, role_id=ae920144abd94ff6b057c1982924d801)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:16.862139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035eca-2c47-4be9-ace1-427a8c7f81f9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:16.876664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:38:16 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/422e32cb1eb345899ec4f2283d5fe828/roles/ae920144abd94ff6b057c1982924d801 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:38:18.759207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414c83-4d27-4768-a6f7-41d835258a41 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:18.759798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414c83-4d27-4768-a6f7-41d835258a41 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:18.759798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414c83-4d27-4768-a6f7-41d835258a41 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:18.761088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:18.766916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:18.767431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:18.767537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:18.786362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:18.787568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:18.861041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:19.136248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414c83-4d27-4768-a6f7-41d835258a41 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:19.163599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:19.252101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414c83-4d27-4768-a6f7-41d835258a41 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:19.290405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:19.291070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:19.291346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:19.291614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:19.302271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:38:19.307711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:19.308719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:19.309584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 6 11:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:19.315530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:19.370477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:19.430073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaf3f5-03c0-45c9-8fbc-4ddc46e701e6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:19.480781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:19.481680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:19.481955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:19.482258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:19.482989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] RBAC: Adding query filter params (name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:19.483294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:19.484674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:19.494061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 6 11:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:19.500586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:19.596517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:19.615974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd03f2-6491-483c-a140-9949cfa7a850 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:19.651929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:19.652600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:19.652878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:19.653117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:19.664016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:19.666409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:19.684026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:19.685212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:19.686182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:19.686182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:19.686182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:19.686182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:19.691341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:19.803342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac19f9-7a83-4f96-a1af-6a0a7ba15c2d None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:19.813261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:19.842182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:19.842881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:19.843165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:19.843454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:19.844107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:19.844416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:19.846037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:19.860021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:19.866384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:19.973575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552723-ced9-46a4-af26-c9e65a9229b6 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:20.007767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:20.008399 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:20.008671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:20.008940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:20.011680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:20.018443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:20.019971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:38:20.033700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:20.034866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:20.035851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:20.042791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:20.160510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aafd9-b3b2-4b28-ab9f-5ef04c8ec569 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:20.195454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:20.196089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:20.196357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:20.196658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:20.197390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:20.197695 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:20.199179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:20.218923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 6 11:38:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:20.226156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:20.337769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa76afc-4fa3-40c6-a270-1d9a0cf85a4f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:20.375852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:20.376535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:20.376825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:20.377150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:20.444833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:20.453043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:20.455017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:20.572999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:38:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:38:20.578909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:20.608625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:20.688741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60339fe5-e76a-4792-a6a1-188b59d4f5d9 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:20.729508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:20.730194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:20.730495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:20.730870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:20.743031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:20.744741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:20.760628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:20.761975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:20.762934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:20.762934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:20.762934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:20.762934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:38:20.769607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:20.872944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:20.879730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d4477-b071-4b27-8411-9f9395c023d0 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:20.915836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:20.916480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:20.916913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:20.917173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:20.917844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:20.918269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:20.920113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:20.933888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:20.939928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:21.032442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:21.058366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee38a65-e754-446a-ba2c-9e0b1edb3313 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:21.101731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:21.102505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:21.103039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:21.103381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:21.112516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:21.114100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:38:21.128115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:21.129200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:21.130143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:21.135697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:21.247896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33726d1d-3a0c-4f89-8bfe-ea4b0c1f9420 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:21.282579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:21.283241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:21.283515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:21.283778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:21.284468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:21.284766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:21.286511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a8a07-ed9d-4897-b0bf-357d54075477 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:21.306188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:21.307363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:21.417111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4bf17-aa2c-4a9e-b579-d0dfcb788921 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:21.454489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:21.455120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:21.455406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:21.455693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:21.456711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] RBAC: Adding query filter params (role.id=ae920144abd94ff6b057c1982924d801, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=422e32cb1eb345899ec4f2283d5fe828) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:21.457016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:21.460085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556f51-1e5c-4cdf-9430-10ec1eed27f9 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:21.467202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:38:21 2022] GET /identity/v3/role_assignments?user.id=422e32cb1eb345899ec4f2283d5fe828&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ae920144abd94ff6b057c1982924d801 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:23.447288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e68b-4358-497c-ac86-9d23206c1c54 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:23.447918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e68b-4358-497c-ac86-9d23206c1c54 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:23.447918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e68b-4358-497c-ac86-9d23206c1c54 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:23.449187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:23.454582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:23.455107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:23.455222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:23.461942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:23.477009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:23.478410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:23.556142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 11:38:23.819814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e68b-4358-497c-ac86-9d23206c1c54 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:23.841105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:23.933419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e68b-4358-497c-ac86-9d23206c1c54 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:23.975046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:23.976444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:23.976763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:23.977020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:23.987974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:38:23.992725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:23.993920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:38:23.994975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:23.998862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:24.000307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:24.115147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3a36d-c008-4262-ad8a-07fda29450e6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:24.151366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:24.157111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:24.158158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:24.158406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:24.158729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:24.159602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:24.159988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:24.161726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:24.171330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:24.177712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:24.266794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:24.294504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24df1-2040-4801-ab8c-21d47e516afa None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:24.330875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:24.331558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:24.331832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:24.332120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:24.342613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:24.344164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:24.360549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:24.361799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:24.362923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:24.362923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:24.362923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:24.362923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:24.367791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:24.476739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fca6d8-9d6b-45c5-877f-f36dafce377f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:24.516421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:24.517247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:24.517379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:24.517601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:24.518277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:24.518583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:24.520079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:24.532759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:24.538945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:24.657537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c485a-401e-42a8-8615-b3a198e4ee8d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:24.687427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:24.698663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:24.699364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:24.699641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:24.699955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:24.709983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:24.711470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:38:24.725480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:24.726571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:24.727840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:24.733332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:24.800527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:24.854241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0f89-c683-475d-985b-3d0414630ae7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:24.897692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:24.898383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:24.898663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:24.898969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:24.899711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:24.900022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:24.901473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:24.924791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 6 11:38:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:24.931298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:25.040525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d999-bd41-41b6-b6cd-5bd186055fe8 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:25.080883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:25.081370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:25.081669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:25.081920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:25.144919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:25.159166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:25.160751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:25.267201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:38:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 11:38:25.273979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:25.401411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6d35-22a8-493f-b7bd-224058430b97 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:25.415838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:25.438144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:25.438817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:25.439096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:25.439364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:25.449555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:25.451078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:25.466063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:25.467240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:25.468928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:25.468928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:25.468928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:25.468928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:25.475737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:25.571270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:25.583875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79086028-8065-4084-a92f-df701795f7b4 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:25.622019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:25.622635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:25.622966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:25.623273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:25.624009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:25.624333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:25.625797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:25.638026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:25.645173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:25.766848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c2dc8-07bb-46ad-8cbc-ab4642be146f None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:25.802578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e93598-2595-452f-b910-edc88264724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:25.803284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93598-2595-452f-b910-edc88264724e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:25.803558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93598-2595-452f-b910-edc88264724e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:25.803821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93598-2595-452f-b910-edc88264724e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:25.814241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e93598-2595-452f-b910-edc88264724e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:25.815775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e93598-2595-452f-b910-edc88264724e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-76e93598-2595-452f-b910-edc88264724e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:38:25.827897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:25.829107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:25.830229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:38:25.835339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:25.954800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080d0ad-1183-4b46-88c9-35f48b778978 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:25.991013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:25.991542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:25.991815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:25.992082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:25.992780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:25.993085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:25.994527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252def0-61c5-4ad6-974e-a233c08f938d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:26.006423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:26.013005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e93598-2595-452f-b910-edc88264724e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:26.041752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:26.136638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e93598-2595-452f-b910-edc88264724e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:26.179326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:26.179946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:26.180219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:26.180499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:26.181324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=422e32cb1eb345899ec4f2283d5fe828) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:26.181614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:26.183091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b152-2c13-4e7c-9c85-103b46cfbc66 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:26.188778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:38:26 2022] GET /identity/v3/role_assignments?user.id=422e32cb1eb345899ec4f2283d5fe828&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:28.045861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6b4b3-1f87-451d-8b93-d6d268670b27 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:28.046417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6b4b3-1f87-451d-8b93-d6d268670b27 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:28.046417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6b4b3-1f87-451d-8b93-d6d268670b27 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:28.047703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:28.053947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:28.054738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:28.054834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:28.077855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:28.079096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:28.154714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:28.415530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6b4b3-1f87-451d-8b93-d6d268670b27 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:28.428591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:28.539287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6b4b3-1f87-451d-8b93-d6d268670b27 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:28.576055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:28.576704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:28.576984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:28.577253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:28.592913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:38:28.597719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:28.599214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:28.600093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:28.605623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:28.628667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:28.715621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb714a80-f75a-4600-addd-b9582e30852f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:28.751677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:28.752275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:28.752543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:28.752802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:28.753454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:28.753744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:28.755148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:28.763035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:28.769145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:28.843054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:28.888139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5beb5-bb35-4cbf-aeb7-3f7b06d93d30 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:28.924085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:28.924705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:28.924981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:28.925249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:28.935692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:28.937144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:28.952136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:28.953280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:28.954294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:28.954294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:28.954294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:28.954294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:28.959268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:29.053247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:29.074357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad851edf-db92-4bf4-a979-d46c3defe633 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:29.114584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:29.115297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:29.115606 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:29.115897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:29.116639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:29.116959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:29.118515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:29.132139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:29.138878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:29.244388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72331d-6591-4dd3-a294-ea97f943d179 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:29.264756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:29.280801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:29.281422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:29.281696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:29.281968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:29.289087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:29.290552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:38:29.302180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:29.303386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:29.304564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:29.309333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:29.412685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63588ae-b00b-40aa-be15-354aad06873c None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:29.449918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:29.450512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:29.450818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:29.451085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:29.451834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:29.452164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:29.453592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:29.462213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:29.471543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 6 11:38:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:29.478339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:29.591250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c633-3346-41ff-a4a1-0d1ec9c05a29 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:29.629843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:29.630454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:29.630728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:29.631013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:29.641848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:29.643346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:29.657564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:29.658660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:29.659607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:29.659607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:29.659607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:29.659607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:29.667055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:29.773916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d11cc7-5345-497f-a835-cedc8b22cf34 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:29.810448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:29.811093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:29.811372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:29.811639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:29.812289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:29.812591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:29.813968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:29.825781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:29.831772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:29.866084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:29.939998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a98fa2-b6fe-4188-a7b0-606b648a3941 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:29.978558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:29.979201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:29.979478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:29.979745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:29.986926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:29.988419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:38:29.999838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:30.000833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:30.001853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:30.006963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:30.068536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:30.114639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba119ca-02a0-40b7-9089-f843f72180c5 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:30.152952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:30.153563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:30.153839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:30.154107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:30.154924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:30.155228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:30.156668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056aa1-b637-4793-bf30-0a79d293bb5a None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:30.168491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:30.174864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:30.288869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:30.303404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0e4f-f558-426e-b871-1f8221f1e66f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:30.341505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f817851-7a64-4355-b87d-6246ea6e31a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:30.342236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f817851-7a64-4355-b87d-6246ea6e31a2 None admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:30.342509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f817851-7a64-4355-b87d-6246ea6e31a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:30.342794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f817851-7a64-4355-b87d-6246ea6e31a2 None admin] PATH_INFO: `/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/422e32cb1eb345899ec4f2283d5fe828/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:30.344956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f817851-7a64-4355-b87d-6246ea6e31a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=edf3ef6e507741c091d37eba762dbdc2, user_id=422e32cb1eb345899ec4f2283d5fe828, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:30.346408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f817851-7a64-4355-b87d-6246ea6e31a2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:30.365422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 6 11:38:30 2022] PUT /identity/v3/projects/edf3ef6e507741c091d37eba762dbdc2/users/422e32cb1eb345899ec4f2283d5fe828/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:38:32.254465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a18c-04f0-44a8-a29c-5b5463bbe531 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:32.255459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a18c-04f0-44a8-a29c-5b5463bbe531 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:32.255459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a18c-04f0-44a8-a29c-5b5463bbe531 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:32.257490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:32.263043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:32.263479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:32.263597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:32.283824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:32.285015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:32.368431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:32.643171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a18c-04f0-44a8-a29c-5b5463bbe531 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:32.760479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a18c-04f0-44a8-a29c-5b5463bbe531 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:32.777950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:32.797714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:32.798350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:32.798627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:32.798932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:32.809949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 11:38:32.814850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:32.816019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:32.817141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 6 11:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:32.822251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:32.907077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:32.931552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c539752-133c-4561-bedc-04e68e3545f6 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:32.966644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:32.967277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:32.967556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:32.967826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:32.968487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:32.968794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:32.970185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:32.978782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 6 11:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:38:32.984997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:33.092966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e9eda-aecb-48cf-89f1-d370e0efbfe7 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:33.130098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:33.130756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:33.131042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:33.131311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:33.141438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:33.142929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:33.157851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:33.158916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:33.159963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:33.159963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:33.159963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:33.159963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:33.165844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:33.276967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9f78a-1862-41c9-a93f-2ed053d7a609 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:33.311789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:33.312382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:33.312657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:33.312925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:33.313557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:33.313862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:33.315271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:33.327753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:33.337129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:33.371304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:33.440355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb970e-f74c-4979-94cc-485f4d97023e None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:33.475060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:33.475687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:33.475965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:33.476234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:33.484079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:33.485517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:38:33.497432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:33.498523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:33.499755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:33.505576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:33.511958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:33.626337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdcf7-8359-4aa3-b6b1-281ec2c12b5d None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:33.662258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:33.662890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:33.663165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:33.663434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:33.664163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:33.664474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:33.665893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:33.683015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 6 11:38:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:33.689151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:33.785873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:33.803796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e077c7-fab5-4613-bd5a-d36a83ef9a87 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:33.841484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:33.842177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:33.842458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:33.842727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:33.913270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:33.914735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:34.014623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:34.031000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 6 11:38:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 11:38:34.036935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:34.102935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:34.149114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8d839-3f60-4a05-b2b8-e71505d9eaad None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:34.184274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:34.184892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:34.185163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:34.185428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:34.195835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:34.197285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:38:34.211878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:34.212963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 11:38:34.213972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:38:34.213972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 11:38:34.213972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:34.213972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:34.221500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:34.328444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cc39-586c-4517-bc6b-f8644807e2bd None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:34.363617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:34.364232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:34.364468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:34.364727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:34.365358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:34.365658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:34.367047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:34.378047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 6 11:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:34.384552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:34.505098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae944d5-c940-4a40-ab33-85a5133bc9a2 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:34.521965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:34.544891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:34.545521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:34.545798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:34.546072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:34.552902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:34.554349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 11:38:34.565946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:34.567068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: ERROR keystone.server.flask.application Sep 06 11:38:34.568588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 6 11:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:34.576398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:34.635208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:34.688229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16755e-c384-4569-b332-ca7e36df65fe None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:34.723457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:34.724066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:34.724344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:34.724611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:34.725299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:34.725600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:34.727070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805410bd-e321-4601-852f-418e1bbf1efe None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:34.739462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 6 11:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:34.745693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:34.852407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdcf36-add8-4b1e-99af-3ece239e4347 None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:34.890224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:34.890767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:34.891042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:34.891308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:34.892031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] RBAC: Adding query filter params (role.id=ca613b7a99764a02bc3ffa26b302575a, scope.project.id=edf3ef6e507741c091d37eba762dbdc2, user.id=422e32cb1eb345899ec4f2283d5fe828) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:34.892340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:34.893788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d70b5-265a-4a4b-bc96-573752e58e2d None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:34.899695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 6 11:38:34 2022] GET /identity/v3/role_assignments?user.id=422e32cb1eb345899ec4f2283d5fe828&scope.project.id=edf3ef6e507741c091d37eba762dbdc2&role.id=ca613b7a99764a02bc3ffa26b302575a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:36.834707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0240305-d2e6-4ee9-ad47-3f3d3c0f6121 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:36.835269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0240305-d2e6-4ee9-ad47-3f3d3c0f6121 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:36.835269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0240305-d2e6-4ee9-ad47-3f3d3c0f6121 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:36.836643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:36.843188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:36.843976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:36.844102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:36.873945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:36.875177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:36.906853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:36.946159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:37.228897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0240305-d2e6-4ee9-ad47-3f3d3c0f6121 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:37.345500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0240305-d2e6-4ee9-ad47-3f3d3c0f6121 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:37.356400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:37.383607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:37.384235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:37.384511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:37.384779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:37.385338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:37.386724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:37.395878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:37.398324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:37.399486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:38:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:37.403220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:37.505289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06b61f-9452-4ea5-9e8b-166c33c3f2ef None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:37.541069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:37.541663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:37.541939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:37.542203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:37.542865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:37.543170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:37.544531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6108cc-b145-46fb-a159-4e39c1a0923c None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:37.549430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 6 11:38:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:38:37.558841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:37.670187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803733c-5be3-4850-877a-9165481e5240 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:37.706973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:37.707584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:37.707863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:37.708134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] PATH_INFO: `/v3/services` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:37.708763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:37.709063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:37.710451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5dc9-5557-4daa-9a8b-d85a2fd495b1 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:37.715278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 6 11:38:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:39.593354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec241f8-fdba-474f-b57c-ca8a1c5d193a None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:39.594287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec241f8-fdba-474f-b57c-ca8a1c5d193a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:39.594287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec241f8-fdba-474f-b57c-ca8a1c5d193a None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:39.596464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:39.602955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0aa9-cbb5-4bcb-8fa4-8dd2f17ac703 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:39.603409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0aa9-cbb5-4bcb-8fa4-8dd2f17ac703 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:39.603516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0aa9-cbb5-4bcb-8fa4-8dd2f17ac703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:39.625963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-573e0aa9-cbb5-4bcb-8fa4-8dd2f17ac703 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:39.627223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-573e0aa9-cbb5-4bcb-8fa4-8dd2f17ac703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:39.660722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:39.705273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:39.966146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec241f8-fdba-474f-b57c-ca8a1c5d193a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:40.022405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:40.104228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec241f8-fdba-474f-b57c-ca8a1c5d193a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:40.146857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4805b-7e6b-4bfb-adfa-7b19e125ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:40.147466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4805b-7e6b-4bfb-adfa-7b19e125ba89 None admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:40.147736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4805b-7e6b-4bfb-adfa-7b19e125ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:40.147998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4805b-7e6b-4bfb-adfa-7b19e125ba89 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:40.148699 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4805b-7e6b-4bfb-adfa-7b19e125ba89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:40.150004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4805b-7e6b-4bfb-adfa-7b19e125ba89 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:40.167680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 6 11:38:39 2022] POST /identity/v3/services => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:38:42.071264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dce56b-77b6-40b2-96ca-015de8ac47ef None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:42.071830 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dce56b-77b6-40b2-96ca-015de8ac47ef None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:42.071830 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dce56b-77b6-40b2-96ca-015de8ac47ef None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:42.073056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:42.079501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:42.080265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:42.080395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:42.105764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:42.106981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:42.181784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:42.450864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dce56b-77b6-40b2-96ca-015de8ac47ef None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:42.573883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dce56b-77b6-40b2-96ca-015de8ac47ef None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:42.622481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:42.623478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:42.623936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:42.624355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:42.625294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:42.627569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:42.641603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:42.642815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:42.643841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:38:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:42.651340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:42.676978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:42.765498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae47097-80c3-4115-81aa-2559a0623d37 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:42.802421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:42.803272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:42.803539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:42.803796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:42.804424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:42.804726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:42.806116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:42.811722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 6 11:38:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:42.820820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:42.854437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:42.924173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a5cfd-21b1-4c9a-ae7b-037d6caaf044 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:42.958853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:42.959446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:42.959723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:42.959996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:42.960688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] RBAC: Adding query filter params (interface=public, service_id=93fcb17086204400b76095b0d61dc54d, region_id=RegionOne) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:42.961004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:42.962379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29bd69-b053-4fe5-b848-ce5cf702fcff None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:42.967603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 6 11:38:42 2022] GET /identity/v3/endpoints?service_id=93fcb17086204400b76095b0d61dc54d&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:42.976823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:43.067854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:43.086896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba3b2e-a444-46d7-8a30-d1ba1cccbf8f None admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:43.129697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ecf4-845f-4971-b3f5-40acced6aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:43.130311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ecf4-845f-4971-b3f5-40acced6aec8 None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:43.130730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ecf4-845f-4971-b3f5-40acced6aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:43.131039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ecf4-845f-4971-b3f5-40acced6aec8 None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:43.131803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ecf4-845f-4971-b3f5-40acced6aec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:43.133503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ecf4-845f-4971-b3f5-40acced6aec8 None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:43.146778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 6 11:38:42 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:38:45.043677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca903-095a-483f-b139-52bf61690f93 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:45.044568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca903-095a-483f-b139-52bf61690f93 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:45.044568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca903-095a-483f-b139-52bf61690f93 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:45.046575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:38:45.052886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:45.053630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:45.053805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:45.076831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:45.078040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:45.150976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:38:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:38:45.415488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca903-095a-483f-b139-52bf61690f93 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:45.525570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:45.533152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca903-095a-483f-b139-52bf61690f93 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:45.568560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:45.569185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:45.569460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:45.569733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:45.570305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:45.571713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:38:45.581001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:38:45.582121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application with Lock( Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: ERROR keystone.server.flask.application Sep 06 11:38:45.583539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 6 11:38:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:38:45.591916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:45.677217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:45.705932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeb7f8-4886-47b0-92dd-773d27a2e8e3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:45.741277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:45.741880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:45.742158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:45.742432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] PATH_INFO: `/v3/services` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:45.743100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:45.743404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:45.744780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3cd3-da00-4523-b80a-b14c4c2f359e None admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:45.752879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 6 11:38:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:45.758797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:45.862066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301496e3-98a8-4ce9-ae96-56d76db75a71 None admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:45.896193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2b0b3-99f8-4867-943e-e4c859c4f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:45.896778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b0b3-99f8-4867-943e-e4c859c4f454 None admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:45.897049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b0b3-99f8-4867-943e-e4c859c4f454 None admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:45.897307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b0b3-99f8-4867-943e-e4c859c4f454 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:45.897958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2b0b3-99f8-4867-943e-e4c859c4f454 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:45.899355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2b0b3-99f8-4867-943e-e4c859c4f454 None admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:45.925829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:38:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:38:55.747525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=30 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:55.917717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:49.619593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5db85-ebb9-43f0-85b0-e0b5c43f3e88 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:49.620175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5db85-ebb9-43f0-85b0-e0b5c43f3e88 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:49.620175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5db85-ebb9-43f0-85b0-e0b5c43f3e88 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:49.625423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:39:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:39:49.626727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c77fb-fb25-4caf-859d-6e466d8f7e3f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:49.627173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c77fb-fb25-4caf-859d-6e466d8f7e3f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:49.627286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c77fb-fb25-4caf-859d-6e466d8f7e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:49.723464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b72c77fb-fb25-4caf-859d-6e466d8f7e3f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:49.724714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b72c77fb-fb25-4caf-859d-6e466d8f7e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:49.838265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:50.126897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563675a-c816-4029-9d6f-641961f87c02 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:50.127186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563675a-c816-4029-9d6f-641961f87c02 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:50.127460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563675a-c816-4029-9d6f-641961f87c02 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:50.129224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 654/1309] 10.222.0.49 () {54 vars in 965 bytes} [Tue Sep 6 11:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:39:50.136469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e2589-edf8-4369-888d-f7f0096c3213 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:50.137068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e2589-edf8-4369-888d-f7f0096c3213 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:50.137653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e2589-edf8-4369-888d-f7f0096c3213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:50.246461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f10e2589-edf8-4369-888d-f7f0096c3213 None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:50.248100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f10e2589-edf8-4369-888d-f7f0096c3213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:50.274191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:50.341208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 656/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Tue Sep 6 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:50.349819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563675a-c816-4029-9d6f-641961f87c02 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:50.352100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3563675a-c816-4029-9d6f-641961f87c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:50.471766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563675a-c816-4029-9d6f-641961f87c02 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:50.555020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:50.555644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:50.555924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:50.556190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:50.557899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:50.619752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:50.677106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:50.678544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335402e-a1e2-4f97-add0-00addf24cd56 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:50.698000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 655/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:52.874897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e6af-6968-4bd2-ad40-9c6774e86ee0 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:52.875471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e6af-6968-4bd2-ad40-9c6774e86ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:52.875471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e6af-6968-4bd2-ad40-9c6774e86ee0 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:52.876996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:39:52.882536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ca86-c9b0-4083-8995-08db94060d4f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:52.883108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ca86-c9b0-4083-8995-08db94060d4f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:52.883108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ca86-c9b0-4083-8995-08db94060d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:52.956660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2764ca86-c9b0-4083-8995-08db94060d4f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:52.957923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2764ca86-c9b0-4083-8995-08db94060d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:53.064201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:53.348045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9e6af-6968-4bd2-ad40-9c6774e86ee0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:53.349648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5ee9e6af-6968-4bd2-ad40-9c6774e86ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:53.459028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9e6af-6968-4bd2-ad40-9c6774e86ee0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:53.535538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:53.538612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:53.539471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:53.539973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:53.540259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:53.542404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:53.654874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:53.656316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d95ad-5ff4-4720-b6bc-4ec53954137f service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:53.675379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 658/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:55.888106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8c48-3598-49c4-861e-abba2da6746e None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:55.888719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8c48-3598-49c4-861e-abba2da6746e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:55.888719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8c48-3598-49c4-861e-abba2da6746e None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:55.890004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 657/1315] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:39:55.896645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190e6d7-4240-4fd3-af39-32f6da47b2d7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:55.897376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190e6d7-4240-4fd3-af39-32f6da47b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:55.897548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190e6d7-4240-4fd3-af39-32f6da47b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:55.980202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6190e6d7-4240-4fd3-af39-32f6da47b2d7 None None] MFA Rules not processed for user `be154751276f477abd85fa8e7f7179c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:55.981345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6190e6d7-4240-4fd3-af39-32f6da47b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:56.043762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:56.091391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 659/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:39:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:56.388023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8c48-3598-49c4-861e-abba2da6746e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:56.390538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0d4a8c48-3598-49c4-861e-abba2da6746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:56.406058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:56.510784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8c48-3598-49c4-861e-abba2da6746e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:56.596031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:56.596637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:56.596913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:56.597181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:56.598874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:56.666963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:56.716863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:56.718323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a1778-0217-4fdd-a934-d5f85e0e47a0 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:56.738415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 658/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:59.169378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d1a2e-3148-4a01-a8b9-c4d3b1e55f75 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:59.169813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d1a2e-3148-4a01-a8b9-c4d3b1e55f75 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:59.169813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d1a2e-3148-4a01-a8b9-c4d3b1e55f75 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:59.172021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 660/1318] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:39:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:39:59.179180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ade04-dce1-4f6f-a4f1-66d548880ba1 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:59.179644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ade04-dce1-4f6f-a4f1-66d548880ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:59.179763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ade04-dce1-4f6f-a4f1-66d548880ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:59.248163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-281ade04-dce1-4f6f-a4f1-66d548880ba1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:59.249397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-281ade04-dce1-4f6f-a4f1-66d548880ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:59.352282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 659/1319] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:39:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:59.635649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d1a2e-3148-4a01-a8b9-c4d3b1e55f75 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:59.638201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ac8d1a2e-3148-4a01-a8b9-c4d3b1e55f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:59.751675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d1a2e-3148-4a01-a8b9-c4d3b1e55f75 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:59.826843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:59.827452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:59.827734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:59.827993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:59.829602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:59.838294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:59.944725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:59.946160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976f9fd-c757-4a55-8549-c99d16fe08dd service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:59.964071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 661/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:02.547667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb97720-3150-43d2-bd59-6754e2e6e617 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:02.548258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb97720-3150-43d2-bd59-6754e2e6e617 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:02.548258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb97720-3150-43d2-bd59-6754e2e6e617 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:02.549846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 660/1321] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:02.555289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ed766-9fef-4188-b572-896d2fd18db1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:02.555754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ed766-9fef-4188-b572-896d2fd18db1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:02.555850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ed766-9fef-4188-b572-896d2fd18db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:02.624359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2d0ed766-9fef-4188-b572-896d2fd18db1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:02.625578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2d0ed766-9fef-4188-b572-896d2fd18db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:02.686656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:02.732772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 662/1322] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:03.018264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb97720-3150-43d2-bd59-6754e2e6e617 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:03.019876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6fb97720-3150-43d2-bd59-6754e2e6e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:03.040478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:03.132328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb97720-3150-43d2-bd59-6754e2e6e617 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:03.210010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:03.210523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:03.210839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:03.211105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:03.212718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:03.287482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:03.327200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:03.328649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09070-420b-4de1-9e84-412ab9a08b50 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:03.347658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 661/1323] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:05.331399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe85dc-131b-4fee-9e4e-f9d783a5edbb None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:05.332003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe85dc-131b-4fee-9e4e-f9d783a5edbb None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:05.332003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe85dc-131b-4fee-9e4e-f9d783a5edbb None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:05.333150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 663/1324] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:05.338496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18881-6671-4c98-9d2d-a1ab0b09523c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:05.338987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18881-6671-4c98-9d2d-a1ab0b09523c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:05.339090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18881-6671-4c98-9d2d-a1ab0b09523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:05.408065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7af18881-6671-4c98-9d2d-a1ab0b09523c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:05.409328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7af18881-6671-4c98-9d2d-a1ab0b09523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:05.510149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 662/1325] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:05.797819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe85dc-131b-4fee-9e4e-f9d783a5edbb None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:05.799409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8bbe85dc-131b-4fee-9e4e-f9d783a5edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:05.914481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe85dc-131b-4fee-9e4e-f9d783a5edbb None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:05.989953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:05.990570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:05.990892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:05.991159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:05.992764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:06.011414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:06.111542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:06.113003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba08d-a8c7-4726-8c53-c28dbea2cc09 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:06.132072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 664/1326] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:08.079515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbfea-43d4-4837-bea3-9e4697ffeecb None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:08.080089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbfea-43d4-4837-bea3-9e4697ffeecb None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:08.080089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbfea-43d4-4837-bea3-9e4697ffeecb None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:08.081447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 663/1327] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:08.086986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb26a52-b7e4-4a38-a807-8755fbbe11ee None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:08.087429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb26a52-b7e4-4a38-a807-8755fbbe11ee None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:08.087672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb26a52-b7e4-4a38-a807-8755fbbe11ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:08.158709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-cfb26a52-b7e4-4a38-a807-8755fbbe11ee None None] MFA Rules not processed for user `be154751276f477abd85fa8e7f7179c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:08.159959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cfb26a52-b7e4-4a38-a807-8755fbbe11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:08.226591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:08.260388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 665/1328] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:08.538570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffbfea-43d4-4837-bea3-9e4697ffeecb None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:08.540175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e8ffbfea-43d4-4837-bea3-9e4697ffeecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:08.572156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:08.647364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffbfea-43d4-4837-bea3-9e4697ffeecb None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:08.722434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:08.723234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:08.723512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:08.723781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:08.725380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:08.809099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:08.848076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:08.849538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19b1f0-0f20-457b-9eb7-bc2bdcbb9960 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:08.868253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 664/1329] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:11.026823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cb413-f8a5-4e4e-92af-d54f256e75a1 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:11.027722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cb413-f8a5-4e4e-92af-d54f256e75a1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:11.027722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cb413-f8a5-4e4e-92af-d54f256e75a1 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:11.029769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 666/1330] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:11.035247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4a4a-63f4-4e89-a94e-bc6388568f58 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:11.035713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4a4a-63f4-4e89-a94e-bc6388568f58 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:11.035828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4a4a-63f4-4e89-a94e-bc6388568f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:11.104584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1a0c4a4a-63f4-4e89-a94e-bc6388568f58 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:11.105848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1a0c4a4a-63f4-4e89-a94e-bc6388568f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:11.205394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 665/1331] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:11.485687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cb413-f8a5-4e4e-92af-d54f256e75a1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:11.488226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5f6cb413-f8a5-4e4e-92af-d54f256e75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:11.607814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cb413-f8a5-4e4e-92af-d54f256e75a1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:11.682251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:11.682896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:11.683173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:11.683445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:11.685042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:11.712183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:11.796761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:11.798192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56a2a0-eace-4e75-9f05-f2afbe94dcba service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:11.830649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 667/1332] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:13.793473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db79ed0-0c37-4cfa-b84d-d234b5346e0c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:13.794065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db79ed0-0c37-4cfa-b84d-d234b5346e0c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:13.794065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db79ed0-0c37-4cfa-b84d-d234b5346e0c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:13.796226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 666/1333] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:13.805094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8a283-6b38-4aed-bda9-547b5e1f274b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:13.805514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8a283-6b38-4aed-bda9-547b5e1f274b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:13.805700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8a283-6b38-4aed-bda9-547b5e1f274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:13.884917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4ac8a283-6b38-4aed-bda9-547b5e1f274b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:13.886145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4ac8a283-6b38-4aed-bda9-547b5e1f274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:13.963104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:13.996727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 668/1334] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:14.282729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db79ed0-0c37-4cfa-b84d-d234b5346e0c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:14.285129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5db79ed0-0c37-4cfa-b84d-d234b5346e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:14.337431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:14.411713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db79ed0-0c37-4cfa-b84d-d234b5346e0c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:14.487481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:14.488111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:14.488384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:14.488649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:14.490275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:14.595009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:14.623112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:14.624576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff91ed-2c8e-4c69-b8d9-74a34e6d4dd0 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:14.645275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 667/1335] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:16.871248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ff883-c74b-4005-9171-5e4ea3dd57ca None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:16.871889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ff883-c74b-4005-9171-5e4ea3dd57ca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:16.871889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ff883-c74b-4005-9171-5e4ea3dd57ca None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:16.873143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 669/1336] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:16.879692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dba9d-6210-44b0-b06d-a2f2a8cf840c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:16.880420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dba9d-6210-44b0-b06d-a2f2a8cf840c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:16.880569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dba9d-6210-44b0-b06d-a2f2a8cf840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:16.954363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e19dba9d-6210-44b0-b06d-a2f2a8cf840c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:16.955521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e19dba9d-6210-44b0-b06d-a2f2a8cf840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:17.054613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 668/1337] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:17.346267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ff883-c74b-4005-9171-5e4ea3dd57ca None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:17.348813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c45ff883-c74b-4005-9171-5e4ea3dd57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:17.466059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ff883-c74b-4005-9171-5e4ea3dd57ca None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:17.543806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:17.544409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:17.544680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:17.544943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:17.546526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:17.582227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:17.658717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:17.660149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffef331-cada-4310-a72b-f3bdcfba1a3d service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:17.678467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 670/1338] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:21.533851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738384-33c9-4793-b54d-6b5cc2fee8b0 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:21.534751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738384-33c9-4793-b54d-6b5cc2fee8b0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:21.534751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738384-33c9-4793-b54d-6b5cc2fee8b0 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:21.535863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 669/1339] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:21.541514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63433999-5dbe-40a2-a496-c002a02d5045 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:21.541971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63433999-5dbe-40a2-a496-c002a02d5045 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:21.542062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63433999-5dbe-40a2-a496-c002a02d5045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:21.616316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-63433999-5dbe-40a2-a496-c002a02d5045 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:21.617551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-63433999-5dbe-40a2-a496-c002a02d5045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:21.713418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:21.726867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 671/1340] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:40:22.023540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2c70-0086-464f-a75d-8f1db1d5ece1 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:22.023928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2c70-0086-464f-a75d-8f1db1d5ece1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:22.024273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2c70-0086-464f-a75d-8f1db1d5ece1 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:22.025725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 965 bytes} [Tue Sep 6 11:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:22.031962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f9cd-c84b-466a-9a29-2c9e571485ba None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:22.032245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f9cd-c84b-466a-9a29-2c9e571485ba None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:22.032516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f9cd-c84b-466a-9a29-2c9e571485ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:22.111157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e4b1f9cd-c84b-466a-9a29-2c9e571485ba None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:22.112272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e4b1f9cd-c84b-466a-9a29-2c9e571485ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:22.190116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1062 bytes} [Tue Sep 6 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:22.199332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2c70-0086-464f-a75d-8f1db1d5ece1 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:22.201002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-924c2c70-0086-464f-a75d-8f1db1d5ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:22.252630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:22.310282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2c70-0086-464f-a75d-8f1db1d5ece1 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:22.389034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:22.389650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:22.389927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:22.390203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:22.391862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:22.489720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:22.507717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:22.509189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb0a6a-5a88-4670-8122-4d1c5fb1020e service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:22.528465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:25.603837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca684-ea3f-417b-807b-0dbf056ba9e4 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:25.604451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca684-ea3f-417b-807b-0dbf056ba9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:25.604451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca684-ea3f-417b-807b-0dbf056ba9e4 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:25.605715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:25.611221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed6b7-e222-48f7-a262-f2a02881c243 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:25.611670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed6b7-e222-48f7-a262-f2a02881c243 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:25.611773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed6b7-e222-48f7-a262-f2a02881c243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:25.681324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-cc4ed6b7-e222-48f7-a262-f2a02881c243 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:25.682554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cc4ed6b7-e222-48f7-a262-f2a02881c243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:25.790758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:26.071875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca684-ea3f-417b-807b-0dbf056ba9e4 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:26.073423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-081ca684-ea3f-417b-807b-0dbf056ba9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:26.165690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:26.183702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca684-ea3f-417b-807b-0dbf056ba9e4 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:26.279610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:26.280226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:26.280501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:26.280766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:26.282370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:26.412198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:26.413960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7a674-5b06-4ef6-b3f2-b5b29f74c6b2 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:26.435565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:30.597383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01365-bb3d-4b69-8ca6-75dab6309c8e None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:30.597957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01365-bb3d-4b69-8ca6-75dab6309c8e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:30.597957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01365-bb3d-4b69-8ca6-75dab6309c8e None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:30.599653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:30.605814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a8096-71c7-4807-a103-47f0eb1d83ea None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:30.606372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a8096-71c7-4807-a103-47f0eb1d83ea None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:30.606478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a8096-71c7-4807-a103-47f0eb1d83ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:30.623991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:30.680124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-799a8096-71c7-4807-a103-47f0eb1d83ea None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:30.681335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-799a8096-71c7-4807-a103-47f0eb1d83ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:30.783506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:31.063978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01365-bb3d-4b69-8ca6-75dab6309c8e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:31.065619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cfb01365-bb3d-4b69-8ca6-75dab6309c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:31.125561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:31.176396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01365-bb3d-4b69-8ca6-75dab6309c8e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:31.256868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:31.257576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:31.257881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:31.258149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:31.262762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:31.369623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:31.372994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:31.374742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b794c-6142-4a36-ba49-db3875608fe0 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:31.393689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:36.256898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a71b5-bd78-40f5-b058-933d12e659fa None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:36.257519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a71b5-bd78-40f5-b058-933d12e659fa None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:36.257519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a71b5-bd78-40f5-b058-933d12e659fa None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:36.259075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:36.269784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970877c8-ee0d-4a2a-9f2b-116d2be44ab4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:36.270291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970877c8-ee0d-4a2a-9f2b-116d2be44ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:36.270663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970877c8-ee0d-4a2a-9f2b-116d2be44ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:36.392908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-970877c8-ee0d-4a2a-9f2b-116d2be44ab4 None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:36.394097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-970877c8-ee0d-4a2a-9f2b-116d2be44ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:36.534710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:40:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:40:40.669312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4e170-9c59-45d9-8f84-8b38cecf61bc None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:40.669868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4e170-9c59-45d9-8f84-8b38cecf61bc None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:40.670162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4e170-9c59-45d9-8f84-8b38cecf61bc None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:40.671643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 677/1352] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:40.677113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea841c-e23b-4fc4-98bd-21f146eb250b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:40.677558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea841c-e23b-4fc4-98bd-21f146eb250b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:40.677830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea841c-e23b-4fc4-98bd-21f146eb250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:40.741827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:40.768795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ccea841c-e23b-4fc4-98bd-21f146eb250b None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:40.770207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ccea841c-e23b-4fc4-98bd-21f146eb250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:40.781565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=59 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:40.880375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 676/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:40:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:42.214734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9927-73cf-48c8-9d02-e341c3d99073 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:42.215359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9927-73cf-48c8-9d02-e341c3d99073 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:42.215359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9927-73cf-48c8-9d02-e341c3d99073 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:42.216629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 678/1354] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:42.222245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096efb-eea1-4325-862a-dc0bf0d1ff31 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:42.222657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096efb-eea1-4325-862a-dc0bf0d1ff31 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:42.222851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096efb-eea1-4325-862a-dc0bf0d1ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:42.302962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-c7096efb-eea1-4325-862a-dc0bf0d1ff31 None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:42.304277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c7096efb-eea1-4325-862a-dc0bf0d1ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:42.349005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:42.423939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 677/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:40:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:45.823578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6555-3d52-4842-966c-437d34166a84 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:45.824125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6555-3d52-4842-966c-437d34166a84 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:45.824125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6555-3d52-4842-966c-437d34166a84 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:45.825460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 679/1356] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:45.831566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574bc9-62ac-4b7a-8394-b7b969e31fa0 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:45.832020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574bc9-62ac-4b7a-8394-b7b969e31fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:45.832114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574bc9-62ac-4b7a-8394-b7b969e31fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:45.919733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-fc574bc9-62ac-4b7a-8394-b7b969e31fa0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:45.920972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fc574bc9-62ac-4b7a-8394-b7b969e31fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:46.050333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 678/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:46.344943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986c5fa-4e3d-4383-b1e0-b06dc534d8ba None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:46.345230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986c5fa-4e3d-4383-b1e0-b06dc534d8ba None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:46.345500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986c5fa-4e3d-4383-b1e0-b06dc534d8ba None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:46.347117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 680/1358] 10.222.0.49 () {54 vars in 962 bytes} [Tue Sep 6 11:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:46.355452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2c54-13d0-46bf-9aa5-986a67bcd9a1 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:46.355820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2c54-13d0-46bf-9aa5-986a67bcd9a1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:46.356243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2c54-13d0-46bf-9aa5-986a67bcd9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:46.377096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:46.446056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ce3b2c54-13d0-46bf-9aa5-986a67bcd9a1 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:46.447502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ce3b2c54-13d0-46bf-9aa5-986a67bcd9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:46.575172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 679/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Sep 6 11:40:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:46.583866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986c5fa-4e3d-4383-b1e0-b06dc534d8ba None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:46.586260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b986c5fa-4e3d-4383-b1e0-b06dc534d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:46.765722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986c5fa-4e3d-4383-b1e0-b06dc534d8ba None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:46.856220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:46.897783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:46.898405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:46.898705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:46.898968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:46.900574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:46.991095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:46.992805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0f340-d4ea-4840-96e0-37765a507303 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:47.011533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 681/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:49.110774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c442b5-2621-45aa-8fb5-d842d8aa5449 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:49.111346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c442b5-2621-45aa-8fb5-d842d8aa5449 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:49.111346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c442b5-2621-45aa-8fb5-d842d8aa5449 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:49.115322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:49.118173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b4fa-8f34-4fdf-83d2-d157d9a66c26 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:49.119460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b4fa-8f34-4fdf-83d2-d157d9a66c26 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:49.119979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b4fa-8f34-4fdf-83d2-d157d9a66c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:49.199330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-7593b4fa-8f34-4fdf-83d2-d157d9a66c26 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:49.201313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7593b4fa-8f34-4fdf-83d2-d157d9a66c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:49.247736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:49.316071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:49.598128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c442b5-2621-45aa-8fb5-d842d8aa5449 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:49.599941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-75c442b5-2621-45aa-8fb5-d842d8aa5449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:49.673818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:49.768199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c442b5-2621-45aa-8fb5-d842d8aa5449 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:49.892991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:49.893914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:49.894377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:49.894959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:49.896896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:49.924952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:50.005454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:50.007361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556772fa-907f-47df-9307-f660e42ea36c service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:50.027522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:52.257402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa4e5-db16-4d24-be40-edf854ca01ca None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:52.257993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa4e5-db16-4d24-be40-edf854ca01ca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:52.257993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa4e5-db16-4d24-be40-edf854ca01ca None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:52.259431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:52.264943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa682-e63e-45a2-8a83-acf6759ede0c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:52.265425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa682-e63e-45a2-8a83-acf6759ede0c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:52.265508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa682-e63e-45a2-8a83-acf6759ede0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:52.333841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-950fa682-e63e-45a2-8a83-acf6759ede0c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:52.335213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-950fa682-e63e-45a2-8a83-acf6759ede0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:52.431834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:52.434179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:40:52.723423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfc51a-78b1-47ed-868d-1aa510116ed8 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:52.723948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfc51a-78b1-47ed-868d-1aa510116ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:52.724446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfc51a-78b1-47ed-868d-1aa510116ed8 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:52.726093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 684/1366] 10.222.0.49 () {54 vars in 962 bytes} [Tue Sep 6 11:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:52.732539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ec6ed-7cc8-4755-9d21-ee11dfabeed9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:52.733055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ec6ed-7cc8-4755-9d21-ee11dfabeed9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:52.733543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ec6ed-7cc8-4755-9d21-ee11dfabeed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:52.813603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7f4ec6ed-7cc8-4755-9d21-ee11dfabeed9 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:52.815221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7f4ec6ed-7cc8-4755-9d21-ee11dfabeed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:52.933081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 683/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Sep 6 11:40:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:52.941244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfc51a-78b1-47ed-868d-1aa510116ed8 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:52.942808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-31bfc51a-78b1-47ed-868d-1aa510116ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:53.098602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfc51a-78b1-47ed-868d-1aa510116ed8 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:53.121583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:53.218438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:53.219083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:53.219356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:53.219614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:53.221208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:53.318977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:53.320923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e144f07-7e60-4667-9915-fd660b5e6fca service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:53.340889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 685/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:53.847797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a099-f3d1-411d-a29a-f38e6d43bb80 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:53.848401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a099-f3d1-411d-a29a-f38e6d43bb80 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:53.848401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a099-f3d1-411d-a29a-f38e6d43bb80 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:53.849891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:53.855527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90128f15-65c9-42b7-b12e-54141ab4d07a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:53.855817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90128f15-65c9-42b7-b12e-54141ab4d07a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:53.856094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90128f15-65c9-42b7-b12e-54141ab4d07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:53.890174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:53.930226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-90128f15-65c9-42b7-b12e-54141ab4d07a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:53.931485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-90128f15-65c9-42b7-b12e-54141ab4d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:54.038876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:54.613130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa24e-7bd6-497a-b84b-3c26dc8ef1f7 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:54.613130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa24e-7bd6-497a-b84b-3c26dc8ef1f7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:54.613130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa24e-7bd6-497a-b84b-3c26dc8ef1f7 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:54.613130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 685/1371] 10.222.0.49 () {54 vars in 964 bytes} [Tue Sep 6 11:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:54.618385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685768-68e6-44a1-911b-38332f521426 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:54.618961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685768-68e6-44a1-911b-38332f521426 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:54.618961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685768-68e6-44a1-911b-38332f521426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:54.695342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e3685768-68e6-44a1-911b-38332f521426 None None] MFA Rules not processed for user `76c4d2542f6145c38255de0387094e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:54.696554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e3685768-68e6-44a1-911b-38332f521426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:54.751339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:54.784358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 687/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Sep 6 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:54.792001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa24e-7bd6-497a-b84b-3c26dc8ef1f7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:54.793531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-278fa24e-7bd6-497a-b84b-3c26dc8ef1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:54.846541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:54.904238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa24e-7bd6-497a-b84b-3c26dc8ef1f7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:54.991925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:54.992554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:54.992830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:54.993098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:54.994911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:55.108592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:55.126143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:55.128074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7f07c-12aa-432a-b5a8-3ff9928d60dc service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:55.152766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 686/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:55.318809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a0c5-7811-423c-aeca-cbfc515164a3 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:55.319103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a0c5-7811-423c-aeca-cbfc515164a3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:55.319379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a0c5-7811-423c-aeca-cbfc515164a3 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:55.320771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 688/1374] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:55.325988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55ea5-2440-45d8-a946-c4771b3d2d03 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:55.326280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55ea5-2440-45d8-a946-c4771b3d2d03 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:55.326553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55ea5-2440-45d8-a946-c4771b3d2d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:55.408180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d3b55ea5-2440-45d8-a946-c4771b3d2d03 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:55.410014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d3b55ea5-2440-45d8-a946-c4771b3d2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:55.508349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 687/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:55.797901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a0c5-7811-423c-aeca-cbfc515164a3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:55.799523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-71a3a0c5-7811-423c-aeca-cbfc515164a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:55.955944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a0c5-7811-423c-aeca-cbfc515164a3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:56.008245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:56.073319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:56.073937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:56.074206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:56.074469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:56.076098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:56.171111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:56.172728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899887ba-7a3f-4b4c-bb69-adf1c589e1b7 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:56.191397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 689/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:58.112618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55907-a669-40e4-ad38-ba2c5967ce32 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:58.113728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55907-a669-40e4-ad38-ba2c5967ce32 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:58.114142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55907-a669-40e4-ad38-ba2c5967ce32 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:58.116066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 688/1377] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:40:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:40:58.122776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310dfa-930a-4a0e-b9b5-15d2bef51db0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:58.123267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310dfa-930a-4a0e-b9b5-15d2bef51db0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:58.123466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310dfa-930a-4a0e-b9b5-15d2bef51db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:58.198177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-61310dfa-930a-4a0e-b9b5-15d2bef51db0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:58.199212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-61310dfa-930a-4a0e-b9b5-15d2bef51db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:58.214803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:58.317359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 690/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:40:58.606708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55907-a669-40e4-ad38-ba2c5967ce32 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:58.608236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-96e55907-a669-40e4-ad38-ba2c5967ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:58.683908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:58.799838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55907-a669-40e4-ad38-ba2c5967ce32 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:58.921151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:58.922107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:58.922359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:58.922655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:58.924296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:58.944091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:59.019568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:59.021173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f33b9-e26d-46d4-aa05-ef521094035f service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:59.041045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 689/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:00.961438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab99dde-299a-4880-8295-e8e31ad0f8ba None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:00.962030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab99dde-299a-4880-8295-e8e31ad0f8ba None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:00.962030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab99dde-299a-4880-8295-e8e31ad0f8ba None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:00.963584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 691/1380] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:00.968830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e528-5a4f-41fa-910b-fb6f2530434a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:00.969276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e528-5a4f-41fa-910b-fb6f2530434a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:00.969276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e528-5a4f-41fa-910b-fb6f2530434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:01.040859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-4c19e528-5a4f-41fa-910b-fb6f2530434a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:01.042090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4c19e528-5a4f-41fa-910b-fb6f2530434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:01.266146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:01.274862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 690/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:01.559011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab99dde-299a-4880-8295-e8e31ad0f8ba None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:01.560556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dab99dde-299a-4880-8295-e8e31ad0f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:01.718980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:01.729111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab99dde-299a-4880-8295-e8e31ad0f8ba None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:01.855698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:01.856310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:01.856659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:01.856988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:01.858659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:01.957918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:01.959651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a2804-75de-4270-9921-d0430c98ea81 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:01.971134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:01.982619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 692/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:03.930707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700ea1-ff12-4679-b233-5022ab15f10a None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:03.931433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700ea1-ff12-4679-b233-5022ab15f10a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:03.931433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700ea1-ff12-4679-b233-5022ab15f10a None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:03.932667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 691/1383] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:03.938043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374c324-055a-406f-9c07-e67380515bcc None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:03.938612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374c324-055a-406f-9c07-e67380515bcc None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:03.938612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374c324-055a-406f-9c07-e67380515bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:04.006881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3374c324-055a-406f-9c07-e67380515bcc None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:04.008085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3374c324-055a-406f-9c07-e67380515bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:04.120242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 693/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:04.404374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2700ea1-ff12-4679-b233-5022ab15f10a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:04.405911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f2700ea1-ff12-4679-b233-5022ab15f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:04.562087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2700ea1-ff12-4679-b233-5022ab15f10a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:04.643102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:04.698977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:04.699844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:04.700302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:04.700659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:04.702907 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:04.814741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:04.816887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72aaf-4af0-4471-8b97-712ddc529b11 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:04.838824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 692/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:06.784998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4406-d302-4f1e-a341-a57ddd0ade33 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:06.785640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4406-d302-4f1e-a341-a57ddd0ade33 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:06.785737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4406-d302-4f1e-a341-a57ddd0ade33 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:06.787775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 694/1386] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:06.795305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877a9f-1716-4fef-b682-ddda30553e76 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:06.795815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877a9f-1716-4fef-b682-ddda30553e76 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:06.795948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877a9f-1716-4fef-b682-ddda30553e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:06.887589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-91877a9f-1716-4fef-b682-ddda30553e76 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:06.889138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-91877a9f-1716-4fef-b682-ddda30553e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:06.932576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:07.007187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 693/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:07.305644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4406-d302-4f1e-a341-a57ddd0ade33 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:07.307284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ad4c4406-d302-4f1e-a341-a57ddd0ade33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:07.387539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:07.460306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4406-d302-4f1e-a341-a57ddd0ade33 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:07.579218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:07.579706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:07.579980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:07.580246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:07.581909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:07.626548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:07.692808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:07.694516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f358e-8a83-4202-b244-d6df7945ff43 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:07.713972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 695/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:09.657086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a98411-7772-48de-9063-5372fb47742a None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:09.657685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a98411-7772-48de-9063-5372fb47742a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:09.657685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a98411-7772-48de-9063-5372fb47742a None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:09.658999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 694/1389] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:09.664326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45861cd-459e-4537-ab40-c9c57a126f47 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:09.664798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45861cd-459e-4537-ab40-c9c57a126f47 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:09.664904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45861cd-459e-4537-ab40-c9c57a126f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:09.734615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c45861cd-459e-4537-ab40-c9c57a126f47 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:09.735906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c45861cd-459e-4537-ab40-c9c57a126f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:09.840645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 696/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:10.110787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6bd3-1a76-4b3a-b04e-664e1f5bb719 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:10.111122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6bd3-1a76-4b3a-b04e-664e1f5bb719 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:10.111331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6bd3-1a76-4b3a-b04e-664e1f5bb719 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:10.113332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 695/1391] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:10.120476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71114fde-bcad-494a-8266-275b57509a30 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:10.120812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71114fde-bcad-494a-8266-275b57509a30 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:10.121247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71114fde-bcad-494a-8266-275b57509a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:10.129520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6bd3-1a76-4b3a-b04e-664e1f5bb719 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:10.131146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-214a6bd3-1a76-4b3a-b04e-664e1f5bb719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:10.137519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:10.189465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-71114fde-bcad-494a-8266-275b57509a30 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:10.190712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-71114fde-bcad-494a-8266-275b57509a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:10.279407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6bd3-1a76-4b3a-b04e-664e1f5bb719 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:10.291943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 697/1392] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:41:10.295968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:10.394413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:10.394958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:10.395232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:10.395500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:10.397123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:10.487864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:10.489466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06783334-7fa0-4060-8e4d-f0a8fc082fe7 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:10.507379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 696/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:10.588906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee4222-5822-45ac-b5a1-a23c5eb45bec None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:10.589189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee4222-5822-45ac-b5a1-a23c5eb45bec None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:10.589471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee4222-5822-45ac-b5a1-a23c5eb45bec None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:10.590940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 698/1394] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 6 11:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:10.597161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796279c7-131e-4a31-bfe8-3bfaf767b96e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:10.597439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796279c7-131e-4a31-bfe8-3bfaf767b96e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:10.597705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796279c7-131e-4a31-bfe8-3bfaf767b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:10.628098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:10.691002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-796279c7-131e-4a31-bfe8-3bfaf767b96e None None] MFA Rules not processed for user `8aaccbf6e1e746f5b7285d57564d9d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:10.692259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-796279c7-131e-4a31-bfe8-3bfaf767b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:10.776164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 697/1395] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 6 11:41:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:10.783959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee4222-5822-45ac-b5a1-a23c5eb45bec None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:10.785498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dfee4222-5822-45ac-b5a1-a23c5eb45bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:10.895457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:10.903425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee4222-5822-45ac-b5a1-a23c5eb45bec None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:10.978363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:10.978919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:10.979186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:10.979475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:10.981096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:11.092225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:11.093669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ee1b-f460-4fba-bade-9c247c5eadfd service glance] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:11.113383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 699/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:11.861613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d57b1-a1a7-4357-a166-3be2de3b64b9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:11.862153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d57b1-a1a7-4357-a166-3be2de3b64b9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:11.862153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d57b1-a1a7-4357-a166-3be2de3b64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:11.929263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-888d57b1-a1a7-4357-a166-3be2de3b64b9 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:11.930494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-888d57b1-a1a7-4357-a166-3be2de3b64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:11.993611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:12.022071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 698/1397] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:41:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:12.064369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a3c60-feae-4b6e-81cd-58b7e5e9268e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:12.064831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a3c60-feae-4b6e-81cd-58b7e5e9268e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:12.064915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a3c60-feae-4b6e-81cd-58b7e5e9268e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:12.066441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 700/1398] 10.222.0.49 () {54 vars in 943 bytes} [Tue Sep 6 11:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:12.073813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0ddd-5b81-41bc-8a0a-743bf5af8ba7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:12.074190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0ddd-5b81-41bc-8a0a-743bf5af8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:12.074592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0ddd-5b81-41bc-8a0a-743bf5af8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:12.155837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0e2c0ddd-5b81-41bc-8a0a-743bf5af8ba7 None None] MFA Rules not processed for user `bc527e0ec230497cb664de8ea319ba7a`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:12.157061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0e2c0ddd-5b81-41bc-8a0a-743bf5af8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:12.267914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 699/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Tue Sep 6 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:12.277457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a3c60-feae-4b6e-81cd-58b7e5e9268e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:12.279081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-aa8a3c60-feae-4b6e-81cd-58b7e5e9268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:12.304885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:12.421480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a3c60-feae-4b6e-81cd-58b7e5e9268e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:12.450835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071670a-9374-43d2-b4d3-8a4a83fec4ec None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:12.451327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071670a-9374-43d2-b4d3-8a4a83fec4ec None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:12.451768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071670a-9374-43d2-b4d3-8a4a83fec4ec None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:12.453123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 700/1400] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:41:12.458906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:12.459430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:12.459898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:12.514367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:12.536961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:12.538199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:12.559318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:12.560323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:12.560604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:12.561012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:12.562833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:12.570180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:12.637573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 701/1401] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:41:12.646673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:12.648382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3b4c8-8e78-4ce2-9213-ec9485b60ad1 service swift] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:12.656456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 701/1402] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:12.930404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:12.931595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:13.055960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323306-062a-4a5f-8d74-2e7e711b6ae7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:13.062341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:13.187324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:13.187862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:13.188145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:13.188413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:13.190073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:13.294266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:13.296119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0bf97-5666-4de9-8b9f-fbe3b2f4fb92 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:13.319457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 702/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:15.250960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632624-8224-42c6-9c82-4c645f87df8f None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:15.251523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632624-8224-42c6-9c82-4c645f87df8f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:15.251523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632624-8224-42c6-9c82-4c645f87df8f None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:15.253021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 702/1404] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:15.258279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91786-eb37-4a10-af9e-d7f61cbf7db1 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:15.258746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91786-eb37-4a10-af9e-d7f61cbf7db1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:15.258970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91786-eb37-4a10-af9e-d7f61cbf7db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:15.270658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:15.331730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-18d91786-eb37-4a10-af9e-d7f61cbf7db1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:15.333107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-18d91786-eb37-4a10-af9e-d7f61cbf7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:15.441801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 703/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:41:15.734767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632624-8224-42c6-9c82-4c645f87df8f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:15.736364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d5632624-8224-42c6-9c82-4c645f87df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:15.899941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632624-8224-42c6-9c82-4c645f87df8f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:15.903568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:16.051432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:16.051970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:16.052252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:16.052502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:16.054182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:16.180334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:16.182804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6eb51-a0f1-4e9d-91c2-372201b068cf service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:16.216678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 703/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:18.136164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e5ed-4a6c-470a-9f29-5e7007722c89 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:18.137172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e5ed-4a6c-470a-9f29-5e7007722c89 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:18.137531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e5ed-4a6c-470a-9f29-5e7007722c89 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:18.139251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 704/1407] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:18.144801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865f17-290a-4fd3-af2f-9f169315d95a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:18.145745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865f17-290a-4fd3-af2f-9f169315d95a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:18.146248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865f17-290a-4fd3-af2f-9f169315d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:18.156380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:18.221305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c2865f17-290a-4fd3-af2f-9f169315d95a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:18.222845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c2865f17-290a-4fd3-af2f-9f169315d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:18.354489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 704/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:18.639291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e5ed-4a6c-470a-9f29-5e7007722c89 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:18.641242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8381e5ed-4a6c-470a-9f29-5e7007722c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:18.742193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:18.811561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e5ed-4a6c-470a-9f29-5e7007722c89 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:18.956460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:18.957212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:18.957492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:18.957766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:18.959455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:19.017589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:19.059977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:19.061609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213c36-6c0c-4d49-acbd-474bbcfb6389 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:19.080509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 705/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:28.342610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=62 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:29.078104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=23 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:34.701088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c672f-5fbc-432e-83b0-f8b0321ec66e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:34.701747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c672f-5fbc-432e-83b0-f8b0321ec66e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:34.701747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c672f-5fbc-432e-83b0-f8b0321ec66e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:34.703029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 705/1410] 10.222.0.49 () {54 vars in 918 bytes} [Tue Sep 6 11:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:34.709150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49110-deb7-4b47-baf2-9e518ad3b6ca None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:34.709622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49110-deb7-4b47-baf2-9e518ad3b6ca None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:34.709738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49110-deb7-4b47-baf2-9e518ad3b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:34.791274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-54e49110-deb7-4b47-baf2-9e518ad3b6ca None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:34.792500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-54e49110-deb7-4b47-baf2-9e518ad3b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:34.907940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 706/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Sep 6 11:41:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:34.922621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e318-ffdf-4a40-a54d-746593844875 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:34.922937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e318-ffdf-4a40-a54d-746593844875 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:34.923209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e318-ffdf-4a40-a54d-746593844875 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:34.924551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 706/1412] 10.222.0.49 () {54 vars in 918 bytes} [Tue Sep 6 11:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:34.930260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891ed4-6742-4131-88de-defb64a84ac9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:34.930716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891ed4-6742-4131-88de-defb64a84ac9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:34.931088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891ed4-6742-4131-88de-defb64a84ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:35.033154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:35.035773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-04891ed4-6742-4131-88de-defb64a84ac9 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:35.037886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-04891ed4-6742-4131-88de-defb64a84ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:35.166584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 707/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Sep 6 11:41:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:37.550612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce540b8-6324-46e9-b320-f5181d2530c1 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:37.551775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce540b8-6324-46e9-b320-f5181d2530c1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:37.551775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce540b8-6324-46e9-b320-f5181d2530c1 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:37.553693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:37.562660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010c1e-e209-4503-a15b-d0526c2dc6bc None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:37.563480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010c1e-e209-4503-a15b-d0526c2dc6bc None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:37.563653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010c1e-e209-4503-a15b-d0526c2dc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:37.645740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-18010c1e-e209-4503-a15b-d0526c2dc6bc None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:37.647571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-18010c1e-e209-4503-a15b-d0526c2dc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:37.713871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:37.754708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:38.047771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce540b8-6324-46e9-b320-f5181d2530c1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:38.050171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0ce540b8-6324-46e9-b320-f5181d2530c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:38.213333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce540b8-6324-46e9-b320-f5181d2530c1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:38.296637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:38.341147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:38.341773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:38.342042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:38.342308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:38.343960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:38.435887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:38.437470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ae0e-ac12-4796-ba5f-6d46ea54db27 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:38.455754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 708/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:39.347270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664e7a-a164-48c0-bf0b-e23b8062b0b5 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:39.347859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664e7a-a164-48c0-bf0b-e23b8062b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:39.347859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664e7a-a164-48c0-bf0b-e23b8062b0b5 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:39.349138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:39.357057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09822426-139d-4c63-9db9-9485e3848dc2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:39.357491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09822426-139d-4c63-9db9-9485e3848dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:39.357586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09822426-139d-4c63-9db9-9485e3848dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:39.437863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-09822426-139d-4c63-9db9-9485e3848dc2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:39.439105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-09822426-139d-4c63-9db9-9485e3848dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:39.466553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:39.538913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:39.693941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5664e7a-a164-48c0-bf0b-e23b8062b0b5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:39.696320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a5664e7a-a164-48c0-bf0b-e23b8062b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:39.863097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5664e7a-a164-48c0-bf0b-e23b8062b0b5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:39.906433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:39.985352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:39.985967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:39.986243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:39.986508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:39.988160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:40.083763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:40.085429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51046a-1cf3-4175-b956-a104095ba826 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:40.104895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 710/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:40.976335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb361ac-a69a-446c-a34d-8423ff119429 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:40.977245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb361ac-a69a-446c-a34d-8423ff119429 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:40.977245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb361ac-a69a-446c-a34d-8423ff119429 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:40.979331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:40.985326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d664a7c-9933-44fd-8b14-2c485284e7f4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:40.985792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d664a7c-9933-44fd-8b14-2c485284e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:40.985909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d664a7c-9933-44fd-8b14-2c485284e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:41.045164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:41.068351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7d664a7c-9933-44fd-8b14-2c485284e7f4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:41.069596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7d664a7c-9933-44fd-8b14-2c485284e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:41.172130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:41.327219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb361ac-a69a-446c-a34d-8423ff119429 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:41.328765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ffb361ac-a69a-446c-a34d-8423ff119429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:41.488062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb361ac-a69a-446c-a34d-8423ff119429 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:41.500234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:41.615074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:41.615699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:41.615973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:41.616240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:41.617873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:41.714576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:41.716947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f1452-c5c0-4bb2-bea6-021773cfcb44 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:41.743932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 711/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:42.600124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c7ef-d26e-4b7b-ba1e-2fc232dcf224 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:42.601106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c7ef-d26e-4b7b-ba1e-2fc232dcf224 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:42.601106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c7ef-d26e-4b7b-ba1e-2fc232dcf224 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:42.603212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:42.611397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51759f-8c3a-44b7-8494-935a811357ed None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:42.611844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51759f-8c3a-44b7-8494-935a811357ed None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:42.611977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51759f-8c3a-44b7-8494-935a811357ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:42.636916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:42.698563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0a51759f-8c3a-44b7-8494-935a811357ed None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:42.699827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0a51759f-8c3a-44b7-8494-935a811357ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:42.803678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:42.960319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c7ef-d26e-4b7b-ba1e-2fc232dcf224 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:42.962773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-16d9c7ef-d26e-4b7b-ba1e-2fc232dcf224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:43.084690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:43.123533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c7ef-d26e-4b7b-ba1e-2fc232dcf224 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:43.240986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:43.241600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:43.241878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:43.242160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:43.243787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:43.331825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:43.349214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:43.351251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ea04f-3f70-495b-8aad-322c22635689 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:43.370208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 713/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:44.258724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532c16-711e-421b-b37f-c4e506fdebb6 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:44.259336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532c16-711e-421b-b37f-c4e506fdebb6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:44.259336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532c16-711e-421b-b37f-c4e506fdebb6 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:44.260644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:44.266450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f986-d707-4a16-9778-704fbb9ba727 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:44.267220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f986-d707-4a16-9778-704fbb9ba727 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:44.267331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f986-d707-4a16-9778-704fbb9ba727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:44.361513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2965f986-d707-4a16-9778-704fbb9ba727 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:44.362727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2965f986-d707-4a16-9778-704fbb9ba727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:44.468913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:44.619485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532c16-711e-421b-b37f-c4e506fdebb6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:44.621781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-23532c16-711e-421b-b37f-c4e506fdebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:44.717289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:44.782164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532c16-711e-421b-b37f-c4e506fdebb6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:44.912390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:44.913015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:44.913268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:44.913533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:44.915195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:44.967474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:45.011935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:45.013536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d866710-638e-42ae-9014-5b03afaa468b service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:45.031988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 714/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:45.836653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03796-1be0-4030-b5d6-7549fd9fbb5f None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:45.837575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03796-1be0-4030-b5d6-7549fd9fbb5f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:45.837575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03796-1be0-4030-b5d6-7549fd9fbb5f None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:45.839838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:45.845822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c06de-6a55-4c3e-b9f2-cc4b6676ed50 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:45.846640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c06de-6a55-4c3e-b9f2-cc4b6676ed50 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:45.846640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c06de-6a55-4c3e-b9f2-cc4b6676ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:45.931172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a40c06de-6a55-4c3e-b9f2-cc4b6676ed50 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:45.932392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a40c06de-6a55-4c3e-b9f2-cc4b6676ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:46.039535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:46.202903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d03796-1be0-4030-b5d6-7549fd9fbb5f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:46.204450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-83d03796-1be0-4030-b5d6-7549fd9fbb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:46.257220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:46.363405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d03796-1be0-4030-b5d6-7549fd9fbb5f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:46.488446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:46.489066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:46.489345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:46.489615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:46.491237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:46.498400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:46.583693 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:46.585349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466b6d0-b861-4468-a320-d9e87ea84d20 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:46.604493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 716/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:47.402603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f9811-c4af-486e-aafe-8a4d9220032e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:47.403289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f9811-c4af-486e-aafe-8a4d9220032e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:47.403289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f9811-c4af-486e-aafe-8a4d9220032e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:47.404539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:47.410750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228c5c8-aad6-4cb4-ab77-90af1045cdd2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:47.411526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228c5c8-aad6-4cb4-ab77-90af1045cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:47.411637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228c5c8-aad6-4cb4-ab77-90af1045cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:47.500843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b228c5c8-aad6-4cb4-ab77-90af1045cdd2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:47.502125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b228c5c8-aad6-4cb4-ab77-90af1045cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:47.574177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:47.610904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:47.781491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f9811-c4af-486e-aafe-8a4d9220032e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:47.783303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-251f9811-c4af-486e-aafe-8a4d9220032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:47.805205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:47.935841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f9811-c4af-486e-aafe-8a4d9220032e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:48.024689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:48.053482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:48.054105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:48.054380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:48.054629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:48.056298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:48.176155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:48.177809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0c95-735e-4a36-af66-bc8f7fd22a2c service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:48.196744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 717/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:49.005379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc3df-c360-4ea2-a1ed-d3d7be61a776 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:49.005943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc3df-c360-4ea2-a1ed-d3d7be61a776 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:49.005943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc3df-c360-4ea2-a1ed-d3d7be61a776 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:49.007204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:49.013071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc4206-210e-4eb5-b71d-4cde0c44a19f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:49.013549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc4206-210e-4eb5-b71d-4cde0c44a19f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:49.013668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc4206-210e-4eb5-b71d-4cde0c44a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:49.103698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-31dc4206-210e-4eb5-b71d-4cde0c44a19f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:49.105464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-31dc4206-210e-4eb5-b71d-4cde0c44a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:49.160839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:49.223261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:49.376194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc3df-c360-4ea2-a1ed-d3d7be61a776 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:49.377653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-da7fc3df-c360-4ea2-a1ed-d3d7be61a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:49.541139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc3df-c360-4ea2-a1ed-d3d7be61a776 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:49.597815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:49.664241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:49.665084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:49.665422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:49.665723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:49.668338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:49.784739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:49.786431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49243c93-4fc8-43d1-812e-6dd01cda6fb3 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:49.808917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 719/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:50.606308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae64b-5a3e-4d06-8c30-eaa5572aea9a None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:50.607325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae64b-5a3e-4d06-8c30-eaa5572aea9a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:50.607325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae64b-5a3e-4d06-8c30-eaa5572aea9a None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:50.609229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:50.614846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a79e7-13fc-474d-9964-4e1e794da234 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:50.615333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a79e7-13fc-474d-9964-4e1e794da234 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:50.615452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a79e7-13fc-474d-9964-4e1e794da234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:50.694496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ac2a79e7-13fc-474d-9964-4e1e794da234 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:50.695763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ac2a79e7-13fc-474d-9964-4e1e794da234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:50.697796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:50.800772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:50.960670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae64b-5a3e-4d06-8c30-eaa5572aea9a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:50.962210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ab7ae64b-5a3e-4d06-8c30-eaa5572aea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:51.126922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae64b-5a3e-4d06-8c30-eaa5572aea9a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:51.159549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:51.264235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:51.264858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:51.265137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:51.265439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:51.267095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:51.363967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:51.365589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053513bd-34b9-45d0-88a1-d2c92b2eef9a service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:51.383890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 720/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:53.196387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc08b-7be1-4c12-b895-a3bd959ac1d3 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:53.197358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc08b-7be1-4c12-b895-a3bd959ac1d3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:53.197358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc08b-7be1-4c12-b895-a3bd959ac1d3 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:53.199519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:41:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:53.205920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4521a-bc33-4301-a9af-f3c3f5dad61c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:53.206398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4521a-bc33-4301-a9af-f3c3f5dad61c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:53.206513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4521a-bc33-4301-a9af-f3c3f5dad61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:53.256752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:53.286092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d7f4521a-bc33-4301-a9af-f3c3f5dad61c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:53.287400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d7f4521a-bc33-4301-a9af-f3c3f5dad61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:53.397748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:53.679879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc08b-7be1-4c12-b895-a3bd959ac1d3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:53.681440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-599fc08b-7be1-4c12-b895-a3bd959ac1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:53.792111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc08b-7be1-4c12-b895-a3bd959ac1d3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:53.824440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:53.869672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:53.870285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:53.870587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:53.870881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:53.872633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:53.993851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:53.995276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a35335-df5c-4b6c-8a4b-ed6b70f2e6a5 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:54.015174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 722/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:56.085224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef05e4-928f-4457-8a9e-cb6343cbf58e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:56.086140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef05e4-928f-4457-8a9e-cb6343cbf58e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:56.086140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef05e4-928f-4457-8a9e-cb6343cbf58e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:56.088093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:41:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:56.094419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb578bfb-194c-4275-ab0b-ed6928bc9f02 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:56.095164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb578bfb-194c-4275-ab0b-ed6928bc9f02 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:56.095324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb578bfb-194c-4275-ab0b-ed6928bc9f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:56.170498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-cb578bfb-194c-4275-ab0b-ed6928bc9f02 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:56.171759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cb578bfb-194c-4275-ab0b-ed6928bc9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:56.184887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:56.290220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:56.579941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef05e4-928f-4457-8a9e-cb6343cbf58e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:56.582480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9cef05e4-928f-4457-8a9e-cb6343cbf58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:56.692397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef05e4-928f-4457-8a9e-cb6343cbf58e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:56.704973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:56.770108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:56.770729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:56.771025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:56.771287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:56.772899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:56.892534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:56.893978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046e8f4-02b9-4f26-b630-15c552912c45 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:56.912203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 723/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:59.141926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765e30-8672-4ab0-8f00-aa4af4afbe7d None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:59.142500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765e30-8672-4ab0-8f00-aa4af4afbe7d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:59.142500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765e30-8672-4ab0-8f00-aa4af4afbe7d None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:59.143777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:41:59.149409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb03a2-419c-4c89-82e8-0f48b75eda06 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:59.149900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb03a2-419c-4c89-82e8-0f48b75eda06 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:59.150341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb03a2-419c-4c89-82e8-0f48b75eda06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:59.199679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:59.226250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0ceb03a2-419c-4c89-82e8-0f48b75eda06 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:59.227526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0ceb03a2-419c-4c89-82e8-0f48b75eda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:59.334941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:59.620182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56765e30-8672-4ab0-8f00-aa4af4afbe7d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:59.621770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-56765e30-8672-4ab0-8f00-aa4af4afbe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:59.740056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56765e30-8672-4ab0-8f00-aa4af4afbe7d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:59.783432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:59.819636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:59.820253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:59.820528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:59.820798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:59.822421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:59.934581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:59.936062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c347da-48b5-47d0-a84c-c241f01622d2 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:59.954822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 725/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:02.043340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6f8f-2de3-4f5f-bedb-3e1ca07b5d2e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:02.044141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6f8f-2de3-4f5f-bedb-3e1ca07b5d2e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:02.044141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6f8f-2de3-4f5f-bedb-3e1ca07b5d2e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:02.045881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:02.052708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621b3fe-579f-4a17-addc-73334f373f23 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:02.053189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621b3fe-579f-4a17-addc-73334f373f23 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:02.053298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621b3fe-579f-4a17-addc-73334f373f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:02.135545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9621b3fe-579f-4a17-addc-73334f373f23 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:02.136777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9621b3fe-579f-4a17-addc-73334f373f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:02.159304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:02.249179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:02.530872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6f8f-2de3-4f5f-bedb-3e1ca07b5d2e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:02.533350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f55e6f8f-2de3-4f5f-bedb-3e1ca07b5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:02.647657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6f8f-2de3-4f5f-bedb-3e1ca07b5d2e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:02.667287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:02.724919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:02.725541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:02.725817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:02.726083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:02.727729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:02.849672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:02.851077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cf8f0-0372-4ef4-b9ef-8691713d8a6e service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:02.870732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 726/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:04.819655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613feff-02da-4daa-9483-ace96d11f79d None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:04.820634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613feff-02da-4daa-9483-ace96d11f79d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:04.820634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613feff-02da-4daa-9483-ace96d11f79d None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:04.822746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:04.829074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca660-6688-44d7-9fab-1ac7b3fc8245 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:04.829862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca660-6688-44d7-9fab-1ac7b3fc8245 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:04.830018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca660-6688-44d7-9fab-1ac7b3fc8245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:04.905057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:04.907989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f24ca660-6688-44d7-9fab-1ac7b3fc8245 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:04.909926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f24ca660-6688-44d7-9fab-1ac7b3fc8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:05.009011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:05.298892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613feff-02da-4daa-9483-ace96d11f79d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:05.301478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e613feff-02da-4daa-9483-ace96d11f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:05.412401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613feff-02da-4daa-9483-ace96d11f79d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:05.473109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:05.508037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:05.508740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:05.508925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:05.509154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:05.510845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:05.627710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:05.629123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f5a2-3f28-4928-b1b4-345d63006caa service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:05.647350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 728/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:07.631829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79399-a661-4019-9811-415b49a52058 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:07.632756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79399-a661-4019-9811-415b49a52058 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:07.632756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79399-a661-4019-9811-415b49a52058 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:07.634924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:07.641420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31f96-65e9-4345-9179-04cccf91e4e8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:07.641905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31f96-65e9-4345-9179-04cccf91e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:07.642093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31f96-65e9-4345-9179-04cccf91e4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:07.716626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-35e31f96-65e9-4345-9179-04cccf91e4e8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:07.717867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-35e31f96-65e9-4345-9179-04cccf91e4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:07.749358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:07.831739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:08.126656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb79399-a661-4019-9811-415b49a52058 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:08.129373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ceb79399-a661-4019-9811-415b49a52058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:08.245539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb79399-a661-4019-9811-415b49a52058 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:08.274495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:08.323326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:08.323947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:08.324220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:08.324486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:08.326115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:08.451806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:08.453264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079b983-f195-4d68-9b7e-5162fcde8779 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:08.474545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 729/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:10.426871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c081f8-8654-4e28-bebc-4e4ffbc93383 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:10.427802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c081f8-8654-4e28-bebc-4e4ffbc93383 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:10.427802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c081f8-8654-4e28-bebc-4e4ffbc93383 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:10.429903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:10.435903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40913d2-135c-450a-b217-8f4d7538aaf4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:10.436360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40913d2-135c-450a-b217-8f4d7538aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:10.436455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40913d2-135c-450a-b217-8f4d7538aaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:10.513061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a40913d2-135c-450a-b217-8f4d7538aaf4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:10.514331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a40913d2-135c-450a-b217-8f4d7538aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:10.523337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:10.629235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:10.911271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c081f8-8654-4e28-bebc-4e4ffbc93383 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:10.913781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-89c081f8-8654-4e28-bebc-4e4ffbc93383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:11.037161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c081f8-8654-4e28-bebc-4e4ffbc93383 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:11.098187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:11.118711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:11.119346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:11.119621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:11.119918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:11.121533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:11.236367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:11.237790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142512a0-a470-4afc-b108-53e8339b4612 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:11.256162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 731/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:13.241068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdaa0b-2ed2-438b-b7c6-6d55c3cdaf15 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:13.241971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdaa0b-2ed2-438b-b7c6-6d55c3cdaf15 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:13.241971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdaa0b-2ed2-438b-b7c6-6d55c3cdaf15 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:13.244163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:13.252830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbd84a-a074-46d6-b5ae-8ce16ae44a2d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:13.253278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbd84a-a074-46d6-b5ae-8ce16ae44a2d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:13.253893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbd84a-a074-46d6-b5ae-8ce16ae44a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:13.327759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e0cbd84a-a074-46d6-b5ae-8ce16ae44a2d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:13.328988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e0cbd84a-a074-46d6-b5ae-8ce16ae44a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:13.371743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:13.430999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:13.713237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdaa0b-2ed2-438b-b7c6-6d55c3cdaf15 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:13.715599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-70cdaa0b-2ed2-438b-b7c6-6d55c3cdaf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:13.839796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdaa0b-2ed2-438b-b7c6-6d55c3cdaf15 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:13.879174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:13.916913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:13.917521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:13.917800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:13.918066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:13.919704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:14.042289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:14.043689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295221-6a6e-4789-8930-6633fbba4891 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:14.062569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 732/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:16.003425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5035c-8923-4846-8fbd-6bab4d12b981 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:16.003985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5035c-8923-4846-8fbd-6bab4d12b981 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:16.003985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5035c-8923-4846-8fbd-6bab4d12b981 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:16.005278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:16.012994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe19d5-9ff3-4253-88ef-62792ebb63ad None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:16.013419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe19d5-9ff3-4253-88ef-62792ebb63ad None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:16.013533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe19d5-9ff3-4253-88ef-62792ebb63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:16.080357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-cbbe19d5-9ff3-4253-88ef-62792ebb63ad None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:16.081637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cbbe19d5-9ff3-4253-88ef-62792ebb63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:16.109557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:16.198782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:16.486432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5035c-8923-4846-8fbd-6bab4d12b981 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:16.488977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-19d5035c-8923-4846-8fbd-6bab4d12b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:16.602268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5035c-8923-4846-8fbd-6bab4d12b981 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:16.669214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:16.677002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:16.677612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:16.677884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:16.678177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:16.680859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:16.796290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:16.797667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24d066-bfed-4a30-bc50-0e36a9bb38f3 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:16.817387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 734/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:18.760718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb5643-8751-4b76-be6c-001ac3b22f26 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:18.761343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb5643-8751-4b76-be6c-001ac3b22f26 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:18.761451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb5643-8751-4b76-be6c-001ac3b22f26 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:18.762833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:18.771067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f386e-b6ac-47f8-a8d8-1e240c114de0 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:18.771549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f386e-b6ac-47f8-a8d8-1e240c114de0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:18.771658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f386e-b6ac-47f8-a8d8-1e240c114de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:18.844996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1a8f386e-b6ac-47f8-a8d8-1e240c114de0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:18.846269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1a8f386e-b6ac-47f8-a8d8-1e240c114de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:18.898773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:18.953864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:19.243473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb5643-8751-4b76-be6c-001ac3b22f26 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:19.245845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e6eb5643-8751-4b76-be6c-001ac3b22f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:19.369809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb5643-8751-4b76-be6c-001ac3b22f26 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:19.419172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:19.446390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:19.447042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:19.447320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:19.447590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:19.449206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:19.574781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:19.576146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bd0c8-b93e-40d2-8bb5-750e2dbae7d5 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:19.596745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 735/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:28.951860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=22 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:29.593654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=66 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:38.928426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f757-952b-4394-9482-d2b28dab6188 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:38.929337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f757-952b-4394-9482-d2b28dab6188 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:38.929337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f757-952b-4394-9482-d2b28dab6188 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:38.931429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 736/1471] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:38.940243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3148-0e53-4c29-80c5-7018bb2f9e86 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:38.940679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3148-0e53-4c29-80c5-7018bb2f9e86 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:38.940788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3148-0e53-4c29-80c5-7018bb2f9e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:39.021736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-9a9a3148-0e53-4c29-80c5-7018bb2f9e86 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:39.022930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9a9a3148-0e53-4c29-80c5-7018bb2f9e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:39.133610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 736/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:39.428030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dd33-3be0-470c-aa62-c964f3ad4681 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:39.428316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dd33-3be0-470c-aa62-c964f3ad4681 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:39.428591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dd33-3be0-470c-aa62-c964f3ad4681 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:39.429957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 737/1473] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 6 11:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:39.435014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebaa45-ee40-45ca-9d47-f4a56cfe7395 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:39.435301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebaa45-ee40-45ca-9d47-f4a56cfe7395 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:39.435594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebaa45-ee40-45ca-9d47-f4a56cfe7395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:39.513376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e4ebaa45-ee40-45ca-9d47-f4a56cfe7395 None None] MFA Rules not processed for user `8aaccbf6e1e746f5b7285d57564d9d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:39.514594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e4ebaa45-ee40-45ca-9d47-f4a56cfe7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:39.535762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:39.725809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 737/1474] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 6 11:42:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:39.733718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4dd33-3be0-470c-aa62-c964f3ad4681 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:39.735326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-54b4dd33-3be0-470c-aa62-c964f3ad4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:39.843634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4dd33-3be0-470c-aa62-c964f3ad4681 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:39.922207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:39.922845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:39.923128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:39.923380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:39.924984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:39.983806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:40.042071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:40.043538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940e728-8424-4979-8bdb-801878f1625a service glance] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:40.062556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 738/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:42.052812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec02c3d-55e9-4ec3-a75a-62ecd3024a91 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:42.053367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec02c3d-55e9-4ec3-a75a-62ecd3024a91 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:42.053367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec02c3d-55e9-4ec3-a75a-62ecd3024a91 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:42.055392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 738/1476] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:42.065471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad193ac1-a5fe-419b-80b9-7b4cc37a9222 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:42.065990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad193ac1-a5fe-419b-80b9-7b4cc37a9222 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:42.066178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad193ac1-a5fe-419b-80b9-7b4cc37a9222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:42.142224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ad193ac1-a5fe-419b-80b9-7b4cc37a9222 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:42.143507 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ad193ac1-a5fe-419b-80b9-7b4cc37a9222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:42.256478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 739/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:42.528120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec02c3d-55e9-4ec3-a75a-62ecd3024a91 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:42.529689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bec02c3d-55e9-4ec3-a75a-62ecd3024a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:42.658574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec02c3d-55e9-4ec3-a75a-62ecd3024a91 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:42.708203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:42.755221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:42.755835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:42.756109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:42.756382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:42.757014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:42.758728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:42:42.758728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:42:42.758728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:42:42.759873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318d619-37f3-48d9-b110-e7bf8ea96dcb admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:42.779071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 739/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 6 11:42:42 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:44.676982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33b97-53c8-4245-91a6-4b8901564bf4 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:44.677605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33b97-53c8-4245-91a6-4b8901564bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:44.677605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33b97-53c8-4245-91a6-4b8901564bf4 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:44.679698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 740/1479] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:44.687559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42346-d296-40dd-a7dc-03406545e26e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:44.688055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42346-d296-40dd-a7dc-03406545e26e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:44.688055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42346-d296-40dd-a7dc-03406545e26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:44.762422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-37d42346-d296-40dd-a7dc-03406545e26e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:44.763673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-37d42346-d296-40dd-a7dc-03406545e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:44.865206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 740/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:42:45.158807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd33b97-53c8-4245-91a6-4b8901564bf4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:45.160478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7bd33b97-53c8-4245-91a6-4b8901564bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:45.171173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:45.314378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd33b97-53c8-4245-91a6-4b8901564bf4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:45.407434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:45.442045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:45.442657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:45.442964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:45.443234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:45.444838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:45.543532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:45.545140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f446d72-5c00-4c27-b222-7b605fcdb2f6 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:45.563303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 741/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:47.651589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e93c12-ce96-4d02-bf32-a05e804447fd None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:47.652185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e93c12-ce96-4d02-bf32-a05e804447fd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:47.652185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e93c12-ce96-4d02-bf32-a05e804447fd None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:47.653479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 741/1482] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:47.658860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56dac6-0c20-473d-8242-ce1a5bab8a92 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:47.659330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56dac6-0c20-473d-8242-ce1a5bab8a92 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:47.659437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56dac6-0c20-473d-8242-ce1a5bab8a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:47.728297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bb56dac6-0c20-473d-8242-ce1a5bab8a92 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:47.729496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bb56dac6-0c20-473d-8242-ce1a5bab8a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:47.778104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:47.833285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 742/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:48.128848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e93c12-ce96-4d02-bf32-a05e804447fd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:48.131391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a0e93c12-ce96-4d02-bf32-a05e804447fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:48.162313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:48.249740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e93c12-ce96-4d02-bf32-a05e804447fd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:48.328154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:48.328759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:48.329030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:48.329298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:48.330925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:48.410967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:48.446419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:48.447960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b416ed-e4e2-4e44-815c-5b63da5637d7 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:48.467163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 742/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:50.441969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d74b9-8af0-40d9-917f-5cca5f412437 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:50.442732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d74b9-8af0-40d9-917f-5cca5f412437 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:50.442732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d74b9-8af0-40d9-917f-5cca5f412437 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:50.444000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 743/1485] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:50.450270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a55d2-95d5-4c75-aab5-9903b134eae1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:50.450975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a55d2-95d5-4c75-aab5-9903b134eae1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:50.451133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a55d2-95d5-4c75-aab5-9903b134eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:50.549354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c28a55d2-95d5-4c75-aab5-9903b134eae1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:50.551202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c28a55d2-95d5-4c75-aab5-9903b134eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:50.667803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 743/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:50.974452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d74b9-8af0-40d9-917f-5cca5f412437 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:50.975992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-750d74b9-8af0-40d9-917f-5cca5f412437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:51.095822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d74b9-8af0-40d9-917f-5cca5f412437 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:51.190289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:51.192881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:51.193786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:51.194357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:51.194666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:51.196808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:51.311387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:51.312841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d8f5-e7f9-4b8a-a5ee-29d24cf621aa service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:51.331913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 744/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:53.311233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607819-3803-4278-90f2-b284a35d57ee None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:53.311805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607819-3803-4278-90f2-b284a35d57ee None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:53.311805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607819-3803-4278-90f2-b284a35d57ee None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:53.313166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 744/1488] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:53.318436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fab79-e980-4047-bae9-7d73e1b44ab4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:53.318958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fab79-e980-4047-bae9-7d73e1b44ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:53.318958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fab79-e980-4047-bae9-7d73e1b44ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:53.385827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7c0fab79-e980-4047-bae9-7d73e1b44ab4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:53.387062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7c0fab79-e980-4047-bae9-7d73e1b44ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:53.443640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:53.491384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 745/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:53.783757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4607819-3803-4278-90f2-b284a35d57ee None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:53.785320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d4607819-3803-4278-90f2-b284a35d57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:53.823773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:53.893487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4607819-3803-4278-90f2-b284a35d57ee None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:53.965355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:53.965888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:53.966158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:53.966423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:53.968073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:54.051528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:54.081637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:54.083162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c68072-e393-4a86-98fe-889b0964fbed service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:54.102213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 745/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:56.224299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4818f7-ef68-4d71-8b62-f95468c06819 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:56.224912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4818f7-ef68-4d71-8b62-f95468c06819 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:56.224912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4818f7-ef68-4d71-8b62-f95468c06819 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:56.226206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 746/1491] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 6 11:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:42:56.232945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c1fa-9e2a-44c9-a424-78976b7bf418 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:56.233670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c1fa-9e2a-44c9-a424-78976b7bf418 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:56.233878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c1fa-9e2a-44c9-a424-78976b7bf418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:56.315206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e745c1fa-9e2a-44c9-a424-78976b7bf418 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:56.316462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e745c1fa-9e2a-44c9-a424-78976b7bf418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:56.419555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 746/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 6 11:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:56.716279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4818f7-ef68-4d71-8b62-f95468c06819 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:56.719280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bc4818f7-ef68-4d71-8b62-f95468c06819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:56.831199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4818f7-ef68-4d71-8b62-f95468c06819 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:56.911055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:56.911663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:56.912004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:56.912272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:56.913874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:56.924352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:57.040408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:57.041797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b657d-452a-4180-be96-83bdf72f01dd service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:57.060497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 747/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:06.418371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=82 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:07.058403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=50 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:32.623324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:32.623978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:32.623978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:32.702031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:44:32.703305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:32.805244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 747/1494] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:44:32.813534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:32.814064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:32.814064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:32.894869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:44:32.896024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:33.001890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 748/1495] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:44:33.006794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:33.008037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:33.020651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc979-495b-458e-a3b5-a94d75d16de1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:33.089401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:33.125252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:33.125866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:33.126131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:33.126401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:33.127064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:44:33.127358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:33.128401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:33.128401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:44:33.128401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:44:33.129279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:33.141081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 748/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:44:33.150161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:33.159707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8dc68-3082-4e44-b24d-f832c538f502 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:33.231373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:33.266251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:33.266890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:33.267163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:33.267423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:33.268040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:33.269769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:33.269769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:44:33.269769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:44:33.270985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:33.330756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 749/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:44:33 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:44:33.334959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:33.336506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:33.372058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2e54-06aa-45a2-8de1-a111a68773f8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:33.483563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:33.484186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:33.484468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:33.484721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:33.485345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:33.486369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:33.486369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:44:33.486369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:44:33.487613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:33.533428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 749/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:44:33 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:44:33.537928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:33.539525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:33.603154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee18b77-9292-4b79-9854-64ff448fc525 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:33.691933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:33.705837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:33.706461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:33.706800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:33.707070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:33.707742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:33.708800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:33.708800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:44:33.708800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:44:33.709716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:33.723017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 750/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:44:33.727287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:33.728833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:33.740769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac10c79-888f-4a53-819b-5d3db9f1ad93 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:33.767679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:33.840448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:33.841066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:33.841342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:33.841610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:33.842249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:33.843303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:33.843303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:44:33.843303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:44:33.844183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480205a-54d7-42b6-83b2-c3ed7b4e9569 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:33.856643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 750/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:44:33.861023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:33.862555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:33.899222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111decfc-d415-4bb0-9741-c78cdc418da7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:34.002723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:34.003336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:34.003607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:34.003875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] PATH_INFO: `/v3/projects/f08bde8b8b0f4956abc16455cdffda6f/users/66f5403c8f374d6984085f256d1b8ef6/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:34.028462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08bde8b8b0f4956abc16455cdffda6f, user_id=66f5403c8f374d6984085f256d1b8ef6, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:34.029500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:34.029500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:44:34.029500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:44:34.031492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0d06f-90b2-4393-8f3c-36ce03fe535f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:34.067269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 751/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:44:33 2022] PUT /identity/v3/projects/f08bde8b8b0f4956abc16455cdffda6f/users/66f5403c8f374d6984085f256d1b8ef6/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:44:34.079716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88b15-bf18-4f8b-9aa3-0a5529f8931a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:34.080004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88b15-bf18-4f8b-9aa3-0a5529f8931a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:34.080258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88b15-bf18-4f8b-9aa3-0a5529f8931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:34.139768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b0e88b15-bf18-4f8b-9aa3-0a5529f8931a None None] MFA Rules not processed for user `66f5403c8f374d6984085f256d1b8ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:44:34.140983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b0e88b15-bf18-4f8b-9aa3-0a5529f8931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:34.223982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 751/1502] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:44:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:44:34.241841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d997c7-a287-4988-a1de-86cefe2480b8 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:34.242130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d997c7-a287-4988-a1de-86cefe2480b8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:34.242399 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d997c7-a287-4988-a1de-86cefe2480b8 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:34.243788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 752/1503] 10.222.0.49 () {54 vars in 964 bytes} [Tue Sep 6 11:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:44:34.249850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373fa2c-830b-49b6-b4d7-4d8974cc24f2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:34.250128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373fa2c-830b-49b6-b4d7-4d8974cc24f2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:34.250396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373fa2c-830b-49b6-b4d7-4d8974cc24f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:34.282994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:34.330189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8373fa2c-830b-49b6-b4d7-4d8974cc24f2 None None] MFA Rules not processed for user `76c4d2542f6145c38255de0387094e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:44:34.331419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8373fa2c-830b-49b6-b4d7-4d8974cc24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:34.406981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 752/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Sep 6 11:44:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:44:34.418889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d997c7-a287-4988-a1de-86cefe2480b8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:34.420430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-90d997c7-a287-4988-a1de-86cefe2480b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:34.484065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:34.540504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d997c7-a287-4988-a1de-86cefe2480b8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:34.618897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:34.619518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:34.619793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:34.620061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:34.621677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:34.733759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:34.735266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:34.738789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:34.754987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 753/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:44:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:44:34.800270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8297-12c2-4af5-a2dd-d68710e4e4eb None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:34.800777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8297-12c2-4af5-a2dd-d68710e4e4eb None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:34.800777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8297-12c2-4af5-a2dd-d68710e4e4eb None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:34.802061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 753/1506] 10.222.0.49 () {52 vars in 830 bytes} [Tue Sep 6 11:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:44:34.805757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:34.806998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:34.913761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b2f13-b7c0-48eb-872e-2c1d113436e1 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:35.014652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:35.015335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:35.015602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:35.015870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] PATH_INFO: `/v3/users/66f5403c8f374d6984085f256d1b8ef6` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:35.028405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f5403c8f374d6984085f256d1b8ef6)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:35.029446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:35.029446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:44:35.029446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:44:35.030641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:35.040700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:35.100085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f5403c8f374d6984085f256d1b8ef6'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:35.100537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f5403c8f374d6984085f256d1b8ef6'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:35.115095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f5403c8f374d6984085f256d1b8ef6'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:35.139667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f5403c8f374d6984085f256d1b8ef6'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:35.140122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f5403c8f374d6984085f256d1b8ef6'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:35.156432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 754/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:44:34 2022] DELETE /identity/v3/users/66f5403c8f374d6984085f256d1b8ef6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:44:35.161092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:35.161398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:35.161667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:35.220317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:44:35.221356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:35.297128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:35.309642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 754/1508] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:44:35.320051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:35.322080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:35.432426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d446b6-d81e-495c-85fd-43a3c9ab4179 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:35.490170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:35.512244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:35.512861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:35.513130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:35.513415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:35.515051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:35.630970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:35.632446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a669ff-5c29-466a-a6ed-852bb3c3d1cf service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:35.651119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 755/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:44:35.988736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:35.989986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:36.003226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35986-59a4-4612-b6a3-8086b591fde8 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:36.101729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:36.102359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:36.102633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:36.102936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] PATH_INFO: `/v3/projects/f08bde8b8b0f4956abc16455cdffda6f` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:36.113388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08bde8b8b0f4956abc16455cdffda6f)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:36.114403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:44:36.114403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:44:36.114403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:44:36.115664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:36.182270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08bde8b8b0f4956abc16455cdffda6f', 'request_id': 'req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:36.189879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08bde8b8b0f4956abc16455cdffda6f', 'request_id': 'req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:36.203763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08bde8b8b0f4956abc16455cdffda6f', 'request_id': 'req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:36.236058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] The token cache is being invalidate because project f08bde8b8b0f4956abc16455cdffda6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:44:36.236247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:36.236739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a05d3c9e-8ea3-47a9-984f-b8cf8e1d7a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:44:36.238051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 755/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:44:35 2022] DELETE /identity/v3/projects/f08bde8b8b0f4956abc16455cdffda6f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:44:45.649189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=62 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:46.234030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:46:10.986431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c046d-a9f9-431a-8455-dc94f320a163 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:10.987074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c046d-a9f9-431a-8455-dc94f320a163 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:10.987074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c046d-a9f9-431a-8455-dc94f320a163 None None] PATH_INFO: `/v3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:10.988222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 756/1511] 10.222.0.52 () {54 vars in 925 bytes} [Tue Sep 6 11:46:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:46:10.995048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c26fce-2423-4407-9650-be590b4c8383 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:10.995549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c26fce-2423-4407-9650-be590b4c8383 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:10.995549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c26fce-2423-4407-9650-be590b4c8383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:11.079885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c3c26fce-2423-4407-9650-be590b4c8383 None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:11.081113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c3c26fce-2423-4407-9650-be590b4c8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:11.200592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 756/1512] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Sep 6 11:46:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:12.716276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8adb-6655-4005-8d93-7f125b21226d None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:12.716778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8adb-6655-4005-8d93-7f125b21226d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:12.716778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8adb-6655-4005-8d93-7f125b21226d None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:12.718189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 757/1513] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:12.724436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401042-1bc4-4b68-bbc2-86bdb1854b4a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:12.725283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401042-1bc4-4b68-bbc2-86bdb1854b4a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:12.725283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401042-1bc4-4b68-bbc2-86bdb1854b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:12.789836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8c401042-1bc4-4b68-bbc2-86bdb1854b4a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:12.791078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8c401042-1bc4-4b68-bbc2-86bdb1854b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:12.810710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:46:12.872981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 757/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:13.027970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8adb-6655-4005-8d93-7f125b21226d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:13.030560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7c7c8adb-6655-4005-8d93-7f125b21226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:13.150470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8adb-6655-4005-8d93-7f125b21226d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:13.156582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c97cd0-23a1-4a7b-b4c1-b3c75829c727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:13.157170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c97cd0-23a1-4a7b-b4c1-b3c75829c727 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:13.157448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c97cd0-23a1-4a7b-b4c1-b3c75829c727 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:13.157717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c97cd0-23a1-4a7b-b4c1-b3c75829c727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:13.165701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c97cd0-23a1-4a7b-b4c1-b3c75829c727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:13.167350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c97cd0-23a1-4a7b-b4c1-b3c75829c727 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:13.176840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 758/1515] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:14.010376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c55027-c7fe-41c7-a08a-1a2f729798bd None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:14.011314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c55027-c7fe-41c7-a08a-1a2f729798bd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:14.011314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c55027-c7fe-41c7-a08a-1a2f729798bd None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:14.013154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:14.019664 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ffc1-362b-44af-88f6-686f7aeb6316 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:14.020553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ffc1-362b-44af-88f6-686f7aeb6316 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:14.020553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ffc1-362b-44af-88f6-686f7aeb6316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:14.050342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f990ffc1-362b-44af-88f6-686f7aeb6316 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:14.051639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f990ffc1-362b-44af-88f6-686f7aeb6316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:14.061148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:14.216218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c55027-c7fe-41c7-a08a-1a2f729798bd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:14.239475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c55027-c7fe-41c7-a08a-1a2f729798bd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:14.246265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40ce45-6270-40ca-89a8-c0dcafefd301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:14.246899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ce45-6270-40ca-89a8-c0dcafefd301 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:14.247178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ce45-6270-40ca-89a8-c0dcafefd301 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:14.247443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ce45-6270-40ca-89a8-c0dcafefd301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:14.256397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ce45-6270-40ca-89a8-c0dcafefd301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:14.258005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ce45-6270-40ca-89a8-c0dcafefd301 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:14.268149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 759/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:18.125471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5ac9-9244-425e-90bc-fd49b7671b10 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:18.126044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5ac9-9244-425e-90bc-fd49b7671b10 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:18.126044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5ac9-9244-425e-90bc-fd49b7671b10 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:18.127324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 760/1519] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 6 11:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:18.132621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6aa18-836c-4217-b2b9-b18bd1b4282c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:18.133068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6aa18-836c-4217-b2b9-b18bd1b4282c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:18.133180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6aa18-836c-4217-b2b9-b18bd1b4282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:18.153782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-36b6aa18-836c-4217-b2b9-b18bd1b4282c None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:18.155016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-36b6aa18-836c-4217-b2b9-b18bd1b4282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:18.165169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 760/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 6 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:18.172740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5ac9-9244-425e-90bc-fd49b7671b10 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:18.189083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5ac9-9244-425e-90bc-fd49b7671b10 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:18.195329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ffdc3-3a0f-4993-a132-0e337c09ab83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:18.195920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffdc3-3a0f-4993-a132-0e337c09ab83 service placement] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:18.196199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffdc3-3a0f-4993-a132-0e337c09ab83 service placement] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:18.196470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffdc3-3a0f-4993-a132-0e337c09ab83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:18.205052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ffdc3-3a0f-4993-a132-0e337c09ab83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:18.206704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ffdc3-3a0f-4993-a132-0e337c09ab83 service placement] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:18.216847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 761/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:25.502567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67fbc-6b59-4658-94d2-1dabf733c142 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:25.503236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67fbc-6b59-4658-94d2-1dabf733c142 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:25.503236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67fbc-6b59-4658-94d2-1dabf733c142 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:25.504483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:25.510537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788137-ce05-45d3-abfb-36ab22d00bee None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:25.511387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788137-ce05-45d3-abfb-36ab22d00bee None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:25.511563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788137-ce05-45d3-abfb-36ab22d00bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:25.542821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f9788137-ce05-45d3-abfb-36ab22d00bee None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:25.544062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f9788137-ce05-45d3-abfb-36ab22d00bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:25.555053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:25.721868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b67fbc-6b59-4658-94d2-1dabf733c142 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:25.737875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b67fbc-6b59-4658-94d2-1dabf733c142 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:25.744229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4337d1-e1a6-4d71-8906-dc6fee26e92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:25.744842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4337d1-e1a6-4d71-8906-dc6fee26e92d service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:25.745121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4337d1-e1a6-4d71-8906-dc6fee26e92d service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:25.745388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4337d1-e1a6-4d71-8906-dc6fee26e92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:25.753971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4337d1-e1a6-4d71-8906-dc6fee26e92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:25.755604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4337d1-e1a6-4d71-8906-dc6fee26e92d service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:25.765325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 762/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:26.611768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdd9c-5c98-444d-ad76-1720925d0c26 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:26.612385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdd9c-5c98-444d-ad76-1720925d0c26 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:26.612385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdd9c-5c98-444d-ad76-1720925d0c26 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:26.613586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 11:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:26.619491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433d0d-b44d-42a2-bb69-9dcc502160d5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:26.620229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433d0d-b44d-42a2-bb69-9dcc502160d5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:26.620386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433d0d-b44d-42a2-bb69-9dcc502160d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:26.643275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-57433d0d-b44d-42a2-bb69-9dcc502160d5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:26.644529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-57433d0d-b44d-42a2-bb69-9dcc502160d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:26.654270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 11:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:26.806747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bdd9c-5c98-444d-ad76-1720925d0c26 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:26.831126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bdd9c-5c98-444d-ad76-1720925d0c26 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:26.839072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8b683-0b55-4148-b9ac-ecf419273f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:26.839672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b683-0b55-4148-b9ac-ecf419273f4e service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:26.839952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b683-0b55-4148-b9ac-ecf419273f4e service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:26.840224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b683-0b55-4148-b9ac-ecf419273f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:26.848904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8b683-0b55-4148-b9ac-ecf419273f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:26.850548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8b683-0b55-4148-b9ac-ecf419273f4e service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:26.860493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 764/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:30.541723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b0a99-798e-4d70-a411-3d1ff3c46aae None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:30.542347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b0a99-798e-4d70-a411-3d1ff3c46aae None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:30.542347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b0a99-798e-4d70-a411-3d1ff3c46aae None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:30.543647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:30.549245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780019-d803-4bc4-b3a5-964bf6112259 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:30.549731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780019-d803-4bc4-b3a5-964bf6112259 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:30.549731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780019-d803-4bc4-b3a5-964bf6112259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:30.570832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-57780019-d803-4bc4-b3a5-964bf6112259 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:30.572050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-57780019-d803-4bc4-b3a5-964bf6112259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:30.580987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:30.868431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b0a99-798e-4d70-a411-3d1ff3c46aae None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:30.871898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-af0b0a99-798e-4d70-a411-3d1ff3c46aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:30.967835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b0a99-798e-4d70-a411-3d1ff3c46aae None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:30.972021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bfce7-5619-4613-9aa8-7cb618a3bebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:30.972630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bfce7-5619-4613-9aa8-7cb618a3bebe service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:30.972910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bfce7-5619-4613-9aa8-7cb618a3bebe service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:30.973183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bfce7-5619-4613-9aa8-7cb618a3bebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:30.982614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bfce7-5619-4613-9aa8-7cb618a3bebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:30.984102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bfce7-5619-4613-9aa8-7cb618a3bebe service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:30.993707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 765/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:32.890875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a983-256a-48cb-93cd-2d6c41692f35 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:32.891495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a983-256a-48cb-93cd-2d6c41692f35 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:32.891495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a983-256a-48cb-93cd-2d6c41692f35 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:32.892774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:32.899455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e97af-6934-480c-8981-6541c449f0d1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:32.899978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e97af-6934-480c-8981-6541c449f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:32.900217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e97af-6934-480c-8981-6541c449f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:32.926991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3d5e97af-6934-480c-8981-6541c449f0d1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:32.928236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3d5e97af-6934-480c-8981-6541c449f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:32.938521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:33.256148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a983-256a-48cb-93cd-2d6c41692f35 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:33.268790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a983-256a-48cb-93cd-2d6c41692f35 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:33.272704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ec774-4462-463d-bf8a-aa0c2598474b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:33.273303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec774-4462-463d-bf8a-aa0c2598474b service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:33.273580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec774-4462-463d-bf8a-aa0c2598474b service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:33.273853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec774-4462-463d-bf8a-aa0c2598474b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:33.282922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ec774-4462-463d-bf8a-aa0c2598474b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:33.284360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ec774-4462-463d-bf8a-aa0c2598474b service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:33.293697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 767/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:36.738344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f283bad-c88e-4a86-94d3-d76c7793ac78 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:36.738888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f283bad-c88e-4a86-94d3-d76c7793ac78 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:36.738993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f283bad-c88e-4a86-94d3-d76c7793ac78 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:36.740359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:36.746637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c692-5184-4375-9ac6-f4861b849496 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:36.747130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c692-5184-4375-9ac6-f4861b849496 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:36.747242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c692-5184-4375-9ac6-f4861b849496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:36.758502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=74 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:46:36.771208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1cd2c692-5184-4375-9ac6-f4861b849496 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:36.772433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1cd2c692-5184-4375-9ac6-f4861b849496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:36.780637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:37.327063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f283bad-c88e-4a86-94d3-d76c7793ac78 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:37.330378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9f283bad-c88e-4a86-94d3-d76c7793ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:37.386711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:46:37.418969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f283bad-c88e-4a86-94d3-d76c7793ac78 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:37.422808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb1fb4-ff91-4cae-8c4b-0b4279881c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:37.423419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1fb4-ff91-4cae-8c4b-0b4279881c20 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:37.423699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1fb4-ff91-4cae-8c4b-0b4279881c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:37.423983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1fb4-ff91-4cae-8c4b-0b4279881c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:37.433134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb1fb4-ff91-4cae-8c4b-0b4279881c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:37.434576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb1fb4-ff91-4cae-8c4b-0b4279881c20 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:37.443968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 768/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:39.372746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f872e-484c-4f86-8951-d49e78f5f8f1 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:39.373643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f872e-484c-4f86-8951-d49e78f5f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:39.373643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f872e-484c-4f86-8951-d49e78f5f8f1 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:39.375825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 11:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:46:39.382131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988eece-b7e7-478b-bec1-d1954e03a69f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:39.382731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988eece-b7e7-478b-bec1-d1954e03a69f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:39.382833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988eece-b7e7-478b-bec1-d1954e03a69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:39.408839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b988eece-b7e7-478b-bec1-d1954e03a69f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:39.410048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b988eece-b7e7-478b-bec1-d1954e03a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:39.419580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 11:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:39.969705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f872e-484c-4f86-8951-d49e78f5f8f1 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:39.971760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0d0f872e-484c-4f86-8951-d49e78f5f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:39.986777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f872e-484c-4f86-8951-d49e78f5f8f1 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:39.991224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428da38-dbe2-4d95-8ada-db1ab4b5ddde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:39.991819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428da38-dbe2-4d95-8ada-db1ab4b5ddde service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:39.992098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428da38-dbe2-4d95-8ada-db1ab4b5ddde service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:39.992371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428da38-dbe2-4d95-8ada-db1ab4b5ddde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:40.007041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428da38-dbe2-4d95-8ada-db1ab4b5ddde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:40.008491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428da38-dbe2-4d95-8ada-db1ab4b5ddde service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:40.018788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 770/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:46:49.403443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=18 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:46:50.014439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=8 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:11.801181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:11.805369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:11.805369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:11.830508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:11.831775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:11.845940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 770/1540] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:11.855589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f0a8-2903-4b54-8839-f219e2feba6a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:11.856630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f0a8-2903-4b54-8839-f219e2feba6a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:11.857112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f0a8-2903-4b54-8839-f219e2feba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:11.884731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e362f0a8-2903-4b54-8839-f219e2feba6a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:11.886616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e362f0a8-2903-4b54-8839-f219e2feba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:11.898888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 771/1541] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:11.904354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:11.918743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52dec-d530-4fd8-a627-ffd4ade4230f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:11.927279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:11.927930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:11.928372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:11.928494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:11.929128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:11.929431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:11.931099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8b26e-8f82-4717-ab0a-7b130d464ec6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:11.954084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 771/1542] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:11.979550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:11.979765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:11.980008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:11.980132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e47d2-05c1-4505-af9d-25d74b20b129 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:11.980370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e47d2-05c1-4505-af9d-25d74b20b129 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:11.980650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e47d2-05c1-4505-af9d-25d74b20b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.026792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-288e47d2-05c1-4505-af9d-25d74b20b129 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.026792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-288e47d2-05c1-4505-af9d-25d74b20b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.027334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.028539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.040632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 772/1543] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.041478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.047703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 772/1544] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:12.048995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf6ee9-f61d-4ea3-a510-9aa649137126 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.049416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf6ee9-f61d-4ea3-a510-9aa649137126 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.049694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf6ee9-f61d-4ea3-a510-9aa649137126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.061726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301969c-d91d-4619-9ad7-47888604e36c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.076413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e6480-f483-4165-83f8-117b2cabf44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.077116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6480-f483-4165-83f8-117b2cabf44e admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.077404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6480-f483-4165-83f8-117b2cabf44e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.077674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6480-f483-4165-83f8-117b2cabf44e admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.078355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e6480-f483-4165-83f8-117b2cabf44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.080317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e6480-f483-4165-83f8-117b2cabf44e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.089013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4aaf6ee9-f61d-4ea3-a510-9aa649137126 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.090893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4aaf6ee9-f61d-4ea3-a510-9aa649137126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.106713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 773/1545] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.106713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae05a8-7ac7-4452-a205-cfe9db5b9655 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.106713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae05a8-7ac7-4452-a205-cfe9db5b9655 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.106713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae05a8-7ac7-4452-a205-cfe9db5b9655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.123611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-18ae05a8-7ac7-4452-a205-cfe9db5b9655 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.124982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-18ae05a8-7ac7-4452-a205-cfe9db5b9655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.138414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 773/1546] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.140329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce06b70-39ec-4438-bc8d-8e61c0bf0f92 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.141011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce06b70-39ec-4438-bc8d-8e61c0bf0f92 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.141586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce06b70-39ec-4438-bc8d-8e61c0bf0f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.150336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 774/1547] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.156184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba5af-1e26-439c-a383-13509594d157 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.156184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba5af-1e26-439c-a383-13509594d157 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.156184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba5af-1e26-439c-a383-13509594d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.175367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2ce06b70-39ec-4438-bc8d-8e61c0bf0f92 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.176656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2ce06b70-39ec-4438-bc8d-8e61c0bf0f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.183246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c09ba5af-1e26-439c-a383-13509594d157 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.184445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c09ba5af-1e26-439c-a383-13509594d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.237616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 774/1548] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.240902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.241291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.241490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.250878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 775/1549] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.252589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.252878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.253152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.261438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.262645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.270529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 775/1550] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.271397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.277315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.278321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.280819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a64a7-3b8f-41fa-862a-b41a2d2a71f8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.285505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.286092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.286368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.290018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.290155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 776/1551] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.290274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.290366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.290454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:48:12.290454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:48:12.290454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:48:12.290454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ab2b6-0795-4924-bd00-05156d5b642a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.297898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f3e61-45ad-4e1c-a553-95d8c440de47 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.304998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.305732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.306047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.306317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.307721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.308225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.310261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd1d7-0814-4e8d-b9cb-1da228c08af0 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.316432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 776/1552] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.317940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227afb7-c801-467b-a559-9f8201e0d712 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.319003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227afb7-c801-467b-a559-9f8201e0d712 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.319442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227afb7-c801-467b-a559-9f8201e0d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.324312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 777/1553] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.325921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.326203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.326529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.348955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d227afb7-c801-467b-a559-9f8201e0d712 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.350168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d227afb7-c801-467b-a559-9f8201e0d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.350332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.351435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.358266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 777/1554] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.359181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 778/1555] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.359479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.359793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.359910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.360085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.372864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e13804-7fec-46b6-a429-8bb144bc6281 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.377564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.378555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.378555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.378784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.379541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.379730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.381444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb8b73-9399-4eb2-9c46-67956aa46f2e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.388718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.390079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.402318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.402318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.402318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.402318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.407152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.407152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.410369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620f305-66e2-41a2-b092-1538c5c21507 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.415264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.415791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.416069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.416338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.416986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.417281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.418304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:48:12.418304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:48:12.418304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:48:12.419210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.421303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.422781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.430915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.438914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.439107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.439225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.443899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18866e-d71e-4ef9-80ef-4db344b5fc43 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.444542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444a62-fd2a-429d-a337-bb834f99c76d admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.448593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836d56c-dfbe-47bd-b13b-349da8122b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.449212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d56c-dfbe-47bd-b13b-349da8122b47 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.449478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d56c-dfbe-47bd-b13b-349da8122b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.449751 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d56c-dfbe-47bd-b13b-349da8122b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.449984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0507a-7ec9-4508-a3f4-95d4e04ac096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.450404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836d56c-dfbe-47bd-b13b-349da8122b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.450648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0507a-7ec9-4508-a3f4-95d4e04ac096 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.450963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0507a-7ec9-4508-a3f4-95d4e04ac096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.451234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0507a-7ec9-4508-a3f4-95d4e04ac096 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.451862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0507a-7ec9-4508-a3f4-95d4e04ac096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.452033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836d56c-dfbe-47bd-b13b-349da8122b47 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.453831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0507a-7ec9-4508-a3f4-95d4e04ac096 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.462647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:12.463661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.463957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.464229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.484213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.485556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.489865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 780/1561] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.489865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.489865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.489865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.508582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:12.509934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:12.545533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 782/1562] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.546465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.552378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:12.553162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:12.557059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247fd7-3e88-4dea-bbf9-7101b9a21f06 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.563039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.563651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.563928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.564203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.564837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.565144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.566807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.574397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:12.575622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.579032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 783/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.579887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.585576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e810ec-0a89-43ff-bba0-2721b40a04f8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.589848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32d494-516f-4806-8f85-71609d1ea160 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.591217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.591865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.592147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.592419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.593053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.594744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.595095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.595337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.595614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.595881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.596547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.596852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.598419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.610637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 784/1565] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.611832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.622229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a54ef-9c63-4d44-a4d6-6031b6df8324 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.627074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.627915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.628063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 782/1566] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.628161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.628508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.628963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.629972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:48:12.629972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:48:12.629972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:48:12.631240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.632289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.662856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 785/1567] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.662856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.696653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8cb77-5dc6-492f-a209-9d6029371794 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.724304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf66f-4625-47f9-a508-0358c80ff388 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.729398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.730029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.730292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.730563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.731236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.733186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.755879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.756102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 786/1568] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.756418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.756694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.756869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.757001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.757597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.759275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.769255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d051cf4-7225-4565-85d5-d5aec9e1a771 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.769573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 783/1569] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:12.770351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.774659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.775537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.775955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.776233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.776869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.777177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.778806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.780326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e6463-8b75-44ab-9e94-6aa0e9171c3a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.784965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.785539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.785834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.786104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.786748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:12.787052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.788607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.791306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 787/1570] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.792139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.801727 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef4bd6-ab72-434f-8c3a-7c4e99545d5c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.804579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 784/1571] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:12.805376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.813169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.813823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.814133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.814408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.815168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.815385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558883-e97c-40ae-8f41-c7f0e44adab7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.817166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.820136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.820764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.821043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.821304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.821929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.823862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.849756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 788/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.849756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.855983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 785/1573] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.856869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.890520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:12.912233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704d73d-a5b4-495d-a013-920e013fb242 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.923654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27416bde-92b2-45d2-b253-6cc0b6a2dc43 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.924942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:12.928624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.929245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.929576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.929806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.930418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.932465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.954508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 786/1574] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:12.955368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.965450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14965f7-8959-4b8b-be7e-381c63cc38dc admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:12.970328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.970954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.971252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.971522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.972154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.972545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:12.973140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:12.973417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:12.973687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:12.973800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.974316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:12.976260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:12.983808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 787/1575] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:12.984802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:12.995290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc36600-5973-4899-b5b3-354cb48df653 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.001303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 789/1576] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.001303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.003256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.003911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.004211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.004482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] PATH_INFO: `/v3/projects/7fdde022bb7d463dba7d00639765fb8a/users/11c7d6d81ffd45ad8468d3f6a05de4e2/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.008810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9585a7-018e-4839-93a7-d5970dd8510d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.013564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.014158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.014442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.014736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.015364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.017312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.019354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdde022bb7d463dba7d00639765fb8a, user_id=11c7d6d81ffd45ad8468d3f6a05de4e2, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.021990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.036044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 788/1577] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:12 2022] PUT /identity/v3/projects/7fdde022bb7d463dba7d00639765fb8a/users/11c7d6d81ffd45ad8468d3f6a05de4e2/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:13.036977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.046203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 790/1578] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:12 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.047097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.108178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9933-cc1d-4bdf-af59-474575cd4436 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.108411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210f5e-9058-49a9-acdd-acda458ab75a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.113951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.114389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.114563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.114879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.115131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.115291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.115412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.115681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.115804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.116305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.117821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.118445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.145282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 791/1579] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.145282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.145554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 789/1580] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.145748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.155192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa95c45-bad5-4316-be1b-191861fed881 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.213211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.213864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.214142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.214438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.215148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.217080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.218900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a070-6f9a-45c9-80fe-f6777e73f2b3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.224517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.225082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.225359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.225625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.226264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.227897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.238339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 790/1581] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.239432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.239570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 792/1582] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.240122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.246633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:13.249263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8bb60-e787-4302-a78a-130e689f0583 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.251424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72629e2a-49c7-4e47-a3ea-748225113121 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.255425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1bee-7a8f-4fa9-9a5f-ff1b25ef07af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.256034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1bee-7a8f-4fa9-9a5f-ff1b25ef07af admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.256311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1bee-7a8f-4fa9-9a5f-ff1b25ef07af admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.256580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1bee-7a8f-4fa9-9a5f-ff1b25ef07af admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.257232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b1bee-7a8f-4fa9-9a5f-ff1b25ef07af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.257635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.258229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.258503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.258878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.259004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b1bee-7a8f-4fa9-9a5f-ff1b25ef07af admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.259433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.260178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:13.261068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.272173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 793/1583] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.272960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.273580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 791/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.274898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.275195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.275470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.284441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917efa-aac3-4ad3-808e-806a29df06a2 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.289080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.289672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.289943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.290209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.290850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.292746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.303716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] MFA Rules not processed for user `11c7d6d81ffd45ad8468d3f6a05de4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:13.305047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:13.314213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 794/1585] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.317955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.327860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666d3b-dc21-4323-a000-551631bcb088 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.334159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.334766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.335057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.335332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.336027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.337670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.347848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 795/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.348692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.358583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f1b5-f84e-47da-8609-97350d2037c7 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.363411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.363991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.364266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.364535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.365152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.367072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.371989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 792/1587] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:13.372832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.385010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4724c5b-3949-4728-a1f0-bf895bc3d1ee None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.389564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.389841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 796/1588] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.390174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.390456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.390731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.391091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.391435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.393110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.400844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2123-faa3-4400-a792-689ff04cd861 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.406606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 793/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.406606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.409906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.410618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.410970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.411214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.411885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.413490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.413604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deb112-ce71-4ace-97b8-db290b8be24d admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.418442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.419126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.419401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.419674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] PATH_INFO: `/v3/projects/b307832b1fb848feabec61709402ecad/users/2c55486a82b54091ad04eaa32fdd3a36/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.426542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 797/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.426542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.434266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885a302-c0d7-4f9c-9e6d-3da8c3b5e33b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.434720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b307832b1fb848feabec61709402ecad, user_id=2c55486a82b54091ad04eaa32fdd3a36, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.437419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.440359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.440952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.441199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.441521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.442143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.444528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.457025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 798/1591] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.457025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.463806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 794/1592] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:13 2022] PUT /identity/v3/projects/b307832b1fb848feabec61709402ecad/users/2c55486a82b54091ad04eaa32fdd3a36/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:13.464835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.468599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088daa6-441f-4c73-95ae-a66de06cb7b8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.528206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad8768-5c21-4838-ab2f-99ffb438f25a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.530953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.531636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.531911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.532182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.532824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.532924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.533468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.533738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.534000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.534423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.534623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.536405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.544412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 799/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.545260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.546118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 795/1594] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.546883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.556385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afacc05-adb1-48d1-801c-04296a496387 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.556650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d34bc-9d80-4d4a-a507-2327deef03c6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.560940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.561517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.561898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.562024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.562138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.562478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.562861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.562973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.563140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.563766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.564433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.565654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.574212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 796/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.574992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.585622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c6045-2b9f-4478-bf95-2ffdb89a7653 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.591048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.591672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.591967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.592240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] PATH_INFO: `/v3/projects/c6a11e9dac3c4ccfa658b43abde16efc/users/fbab55a55b194d2fb5a3837e3ff758fc/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.600080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 800/1596] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.600080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.608216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a11e9dac3c4ccfa658b43abde16efc, user_id=fbab55a55b194d2fb5a3837e3ff758fc, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.610966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.624710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 797/1597] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:13 2022] PUT /identity/v3/projects/c6a11e9dac3c4ccfa658b43abde16efc/users/fbab55a55b194d2fb5a3837e3ff758fc/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:13.625710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.639556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:13.662520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77917-a8a1-4eeb-b94b-42bb147dd1a3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.666365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:13.690216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489915-8913-4428-8807-bdfb90a617ad admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.694990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf291bd-d8eb-4dac-abe0-3cce16f7707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.695650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf291bd-d8eb-4dac-abe0-3cce16f7707c admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.695920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf291bd-d8eb-4dac-abe0-3cce16f7707c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.696191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf291bd-d8eb-4dac-abe0-3cce16f7707c admin admin] PATH_INFO: `/v3/projects/2bfd839a8d424c6a838ef2c15ed4a7f8/users/4e30b4dc1b79465d97cbd20dbc5b8b0f/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.711064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf291bd-d8eb-4dac-abe0-3cce16f7707c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfd839a8d424c6a838ef2c15ed4a7f8, user_id=4e30b4dc1b79465d97cbd20dbc5b8b0f, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.714281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf291bd-d8eb-4dac-abe0-3cce16f7707c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.725764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.726395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.726675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.726977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.727628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.727763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 798/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:13 2022] PUT /identity/v3/projects/2bfd839a8d424c6a838ef2c15ed4a7f8/users/4e30b4dc1b79465d97cbd20dbc5b8b0f/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:13.728869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.729156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.729284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.729442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.742755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 801/1599] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.743755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.750415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:13.751668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:13.754025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29eb861-3d97-463a-83c2-800cd1bf9486 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.808892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.809577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.809672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.809877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 799/1600] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:13.810025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.810724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.810831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.812368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.820578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d6764-c3e3-45d7-b406-2192474884a9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.822937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 802/1601] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.823827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.825736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82db99-aa44-4900-b3ad-d0b25e177ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.826450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82db99-aa44-4900-b3ad-d0b25e177ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.826797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82db99-aa44-4900-b3ad-d0b25e177ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.827159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82db99-aa44-4900-b3ad-d0b25e177ff8 admin admin] PATH_INFO: `/v3/projects/f6d17390167b4b2f878b6c18fe0cdddb/users/6f56d81c90714d7584d80cf3fb1d4075/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.833967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053a91-d92c-4b33-8d2b-90dd71165462 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.838735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.839329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.839586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.839842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.840491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.842071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.843123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82db99-aa44-4900-b3ad-d0b25e177ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d17390167b4b2f878b6c18fe0cdddb, user_id=6f56d81c90714d7584d80cf3fb1d4075, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.845970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82db99-aa44-4900-b3ad-d0b25e177ff8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.852669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 803/1602] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:13.853605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.862995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 800/1603] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:13 2022] PUT /identity/v3/projects/f6d17390167b4b2f878b6c18fe0cdddb/users/6f56d81c90714d7584d80cf3fb1d4075/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:13.864239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d0dac-1b0f-4006-9e65-27b122198d0a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.864516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d0dac-1b0f-4006-9e65-27b122198d0a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.864781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d0dac-1b0f-4006-9e65-27b122198d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.866752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220666-dc7b-4ba4-bb34-adecd3ce2d5d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.883563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1b9d0dac-1b0f-4006-9e65-27b122198d0a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:13.884766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1b9d0dac-1b0f-4006-9e65-27b122198d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:13.924296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.925064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.925330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.925595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.926222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.928388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.946489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 801/1604] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:13.947877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.948638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.948638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.953878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 804/1605] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:13.953878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:13.962265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9272d-e244-4d0a-8b58-a89a0cfbfdb9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:13.967071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:13.967718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:13.967991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:13.968255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] PATH_INFO: `/v3/projects/bbe5dfa9163b4ec0858cd209522258f5/users/beb78ae36e634dc3aab38916160e6275/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:13.974170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:13.983115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] MFA Rules not processed for user `4e30b4dc1b79465d97cbd20dbc5b8b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:13.984926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe5dfa9163b4ec0858cd209522258f5, user_id=beb78ae36e634dc3aab38916160e6275, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:13.985235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:13.986023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:48:13.986023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:48:13.986023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:48:13.988056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:13.990292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.005531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 805/1606] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:13 2022] PUT /identity/v3/projects/bbe5dfa9163b4ec0858cd209522258f5/users/beb78ae36e634dc3aab38916160e6275/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:14.006341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.061548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 802/1607] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.062388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.062520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788232-6602-48b0-a4c4-bf2fc0c356eb admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.066914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.067606 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.067951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.068290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.073197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ff34-08ca-4d17-8202-f806958da9b7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.134665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144366-bffc-4a53-8157-7ffa590aa818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.135367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144366-bffc-4a53-8157-7ffa590aa818 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.135661 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144366-bffc-4a53-8157-7ffa590aa818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.135932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144366-bffc-4a53-8157-7ffa590aa818 admin admin] PATH_INFO: `/v3/projects/7c3b0e90226245e58b81f2cdc9c2492e/users/29e23a6520554348834454a31a95591f/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.137771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.139275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.149156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 806/1608] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:14.150059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.151502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144366-bffc-4a53-8157-7ffa590aa818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3b0e90226245e58b81f2cdc9c2492e, user_id=29e23a6520554348834454a31a95591f, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.154190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144366-bffc-4a53-8157-7ffa590aa818 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.161399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e99e89-82db-4005-95e5-1000fe7e8e5b service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.168763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.169700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.170124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.170467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] PATH_INFO: `/v3/projects/48a766ebf062434496650429c5d35499/users/b96b1bf4594d47339e57fd4b121c3dff/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.174767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 803/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:14 2022] PUT /identity/v3/projects/7c3b0e90226245e58b81f2cdc9c2492e/users/29e23a6520554348834454a31a95591f/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:14.176427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.176823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.177140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.197061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a766ebf062434496650429c5d35499, user_id=b96b1bf4594d47339e57fd4b121c3dff, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.200230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.202362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:14.205392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.216109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 807/1610] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:14 2022] PUT /identity/v3/projects/48a766ebf062434496650429c5d35499/users/b96b1bf4594d47339e57fd4b121c3dff/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:14.216932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.282740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 804/1611] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.287490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.291171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4717763-749d-43ff-93c6-18cfe9874bdd admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.299078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfacf6-256b-4b97-b2a2-8e8776dd6784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.299811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfacf6-256b-4b97-b2a2-8e8776dd6784 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.300089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfacf6-256b-4b97-b2a2-8e8776dd6784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.300357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfacf6-256b-4b97-b2a2-8e8776dd6784 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.301004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfacf6-256b-4b97-b2a2-8e8776dd6784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.302618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfacf6-256b-4b97-b2a2-8e8776dd6784 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.314443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 808/1612] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:14.316025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc344c-f4bd-4d64-9acf-c9e872435d42 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.316025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc344c-f4bd-4d64-9acf-c9e872435d42 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.316238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc344c-f4bd-4d64-9acf-c9e872435d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.329621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.349728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8dcc344c-f4bd-4d64-9acf-c9e872435d42 None None] MFA Rules not processed for user `beb78ae36e634dc3aab38916160e6275`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:14.351433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8dcc344c-f4bd-4d64-9acf-c9e872435d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.358637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.377023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb78a-eeea-4442-aa97-247844a8963e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.434580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 809/1613] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.436150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660034c-0393-4647-8efd-bd04183a5d3c None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.436150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660034c-0393-4647-8efd-bd04183a5d3c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.436477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660034c-0393-4647-8efd-bd04183a5d3c None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.438243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 810/1614] 10.222.0.49 () {54 vars in 962 bytes} [Tue Sep 6 11:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:14.439980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.440338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f6c0-7540-4d2a-b507-06ddf42806b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.440615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.441040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f6c0-7540-4d2a-b507-06ddf42806b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.441211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.441333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f6c0-7540-4d2a-b507-06ddf42806b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.441572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f6c0-7540-4d2a-b507-06ddf42806b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.453799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f6c0-7540-4d2a-b507-06ddf42806b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.455461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f6c0-7540-4d2a-b507-06ddf42806b7 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.466167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 805/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:14.467372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.467657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.467953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.471992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] MFA Rules not processed for user `29e23a6520554348834454a31a95591f`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:14.473314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.500700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] MFA Rules not processed for user `b96b1bf4594d47339e57fd4b121c3dff`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:14.502304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.580149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 811/1616] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.581255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.583580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.599512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7110483-c6df-4eca-a0bb-5784dc7aa559 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.604838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.605381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.605664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.605970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.619069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.620919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.639632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 812/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:14.644624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.668018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3883e5-7373-40f2-9a39-0161f7063b30 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.669188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 806/1618] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.670509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.685800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fbfa8-e959-4985-8143-e1287e159bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.686075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660176-b57d-4ee2-86a8-be86ec818a43 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.686527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fbfa8-e959-4985-8143-e1287e159bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.686895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fbfa8-e959-4985-8143-e1287e159bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.687707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fbfa8-e959-4985-8143-e1287e159bc1 admin admin] PATH_INFO: `/v3/projects/570e0b9927bd4f72bfc7573a7a7cccfe/users/7f64e34f033f4ea7a5387591544917ad/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.692165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be9d07-aa5f-450a-9df9-80555ff9fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.693373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be9d07-aa5f-450a-9df9-80555ff9fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.693764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be9d07-aa5f-450a-9df9-80555ff9fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.694108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be9d07-aa5f-450a-9df9-80555ff9fc73 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.694895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be9d07-aa5f-450a-9df9-80555ff9fc73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.697323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be9d07-aa5f-450a-9df9-80555ff9fc73 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.722023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fbfa8-e959-4985-8143-e1287e159bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570e0b9927bd4f72bfc7573a7a7cccfe, user_id=7f64e34f033f4ea7a5387591544917ad, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.727073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fbfa8-e959-4985-8143-e1287e159bc1 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.747743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 813/1619] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:14 2022] PUT /identity/v3/projects/570e0b9927bd4f72bfc7573a7a7cccfe/users/7f64e34f033f4ea7a5387591544917ad/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:14.749333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.749810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.750252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.751521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 807/1620] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:14.753499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188cb0-2ab0-4ed0-8208-1324bb2871cd None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.753836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188cb0-2ab0-4ed0-8208-1324bb2871cd None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.754148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188cb0-2ab0-4ed0-8208-1324bb2871cd None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.755518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 808/1621] 10.222.0.49 () {54 vars in 962 bytes} [Tue Sep 6 11:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:14.761539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72188cb0-2ab0-4ed0-8208-1324bb2871cd None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.812405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:14.813927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.842160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.867077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72188cb0-2ab0-4ed0-8208-1324bb2871cd None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.869467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.875042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a6f36-d9a6-4425-bd8c-fbb2b193b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.877049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a6f36-d9a6-4425-bd8c-fbb2b193b204 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.877775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a6f36-d9a6-4425-bd8c-fbb2b193b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.878196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a6f36-d9a6-4425-bd8c-fbb2b193b204 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.879514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a6f36-d9a6-4425-bd8c-fbb2b193b204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.883271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a6f36-d9a6-4425-bd8c-fbb2b193b204 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.912199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 814/1622] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.913215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 809/1623] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:14.913344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.914784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.915203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.915602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.927474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84185437-e543-4996-9ade-19c11e5c66f3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.932570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:14.933200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:14.933475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:14.933745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:14.934526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:14.937031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:14.941543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:14.943188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:14.961705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 810/1624] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:14.962658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:14.986367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842379c-4c65-4aab-8ce5-5965b6086142 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:14.991508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 815/1625] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:14 2022] POST /identity/v3/users => generated 293 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:14.996850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.005157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.005893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.006163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.007149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] PATH_INFO: `/v3/projects/570e0b9927bd4f72bfc7573a7a7cccfe/users/7f64e34f033f4ea7a5387591544917ad/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.009798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570e0b9927bd4f72bfc7573a7a7cccfe, user_id=7f64e34f033f4ea7a5387591544917ad, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.011244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22476-38c5-4b05-974f-0f8be0af9f10 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.012849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.017990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.019201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.019486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.019768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.035375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 811/1626] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:14 2022] PUT /identity/v3/projects/570e0b9927bd4f72bfc7573a7a7cccfe/users/7f64e34f033f4ea7a5387591544917ad/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:15.036292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.099318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.101247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.112162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 816/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:15.112981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.123321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb11108-7c1d-4c6e-92bf-e794a5c07d56 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.207099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab3e8-22fc-42a0-b8e7-16f5d7e2ebd3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.225706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.225706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.226040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.226262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.228180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb0b1a-7447-4dea-806a-ea695a0789d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.228800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0b1a-7447-4dea-806a-ea695a0789d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.229072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0b1a-7447-4dea-806a-ea695a0789d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.229337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0b1a-7447-4dea-806a-ea695a0789d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.230409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0b1a-7447-4dea-806a-ea695a0789d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.232048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0b1a-7447-4dea-806a-ea695a0789d8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.254487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 817/1628] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:15.260167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.260167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.260167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.326544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] MFA Rules not processed for user `7f64e34f033f4ea7a5387591544917ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:15.327835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:15.352576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.355113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.386119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 812/1629] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:15.387102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.418954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72b94-7deb-40b7-82e2-85f3faa4523d service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.442120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81a376-3a3e-4513-b16c-7813b72ed186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.442885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a376-3a3e-4513-b16c-7813b72ed186 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.443188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a376-3a3e-4513-b16c-7813b72ed186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.443458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a376-3a3e-4513-b16c-7813b72ed186 admin admin] PATH_INFO: `/v3/projects/780b6ddd322a4020bf3847c991b5af77/users/737b2a5b21564d08ad5e4d5f11c009b8/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.453001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:15.481059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81a376-3a3e-4513-b16c-7813b72ed186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780b6ddd322a4020bf3847c991b5af77, user_id=737b2a5b21564d08ad5e4d5f11c009b8, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.484113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81a376-3a3e-4513-b16c-7813b72ed186 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.518736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 813/1630] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:15 2022] PUT /identity/v3/projects/780b6ddd322a4020bf3847c991b5af77/users/737b2a5b21564d08ad5e4d5f11c009b8/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:15.519402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 818/1631] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:15 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:15.519994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c857ef-e8b3-40e6-9441-57152081dafc None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.520287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c857ef-e8b3-40e6-9441-57152081dafc None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.520935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c857ef-e8b3-40e6-9441-57152081dafc None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.521681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.522089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 814/1632] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 6 11:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:15.527402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c857ef-e8b3-40e6-9441-57152081dafc None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.543258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd072da8-3243-411a-a33a-0dfd27c46dec None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.612922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:15.641948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c857ef-e8b3-40e6-9441-57152081dafc None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.653027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.653755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.654213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.654487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.670633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38078f87-8c21-428a-911e-27a061e74481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.671398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38078f87-8c21-428a-911e-27a061e74481 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.671772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38078f87-8c21-428a-911e-27a061e74481 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.672288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38078f87-8c21-428a-911e-27a061e74481 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.673534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38078f87-8c21-428a-911e-27a061e74481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.675117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38078f87-8c21-428a-911e-27a061e74481 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.697247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 819/1633] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:15.698762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.701933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.702292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.755165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:15.756290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:15.809149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.812726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.834105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 815/1634] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:15.835127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.859290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa852f-31ef-40a2-a2f9-261974b66225 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.871481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff4b83-495a-45cb-a6d3-f697e6face70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:15.872172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4b83-495a-45cb-a6d3-f697e6face70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.872441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4b83-495a-45cb-a6d3-f697e6face70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.872725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4b83-495a-45cb-a6d3-f697e6face70 admin admin] PATH_INFO: `/v3/projects/780b6ddd322a4020bf3847c991b5af77/users/737b2a5b21564d08ad5e4d5f11c009b8/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.877852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff4b83-495a-45cb-a6d3-f697e6face70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780b6ddd322a4020bf3847c991b5af77, user_id=737b2a5b21564d08ad5e4d5f11c009b8, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:15.883280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff4b83-495a-45cb-a6d3-f697e6face70 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:15.900837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 820/1635] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:15.901510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:15.903564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 816/1636] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:15 2022] PUT /identity/v3/projects/780b6ddd322a4020bf3847c991b5af77/users/737b2a5b21564d08ad5e4d5f11c009b8/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:15.914067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:15.915553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:15.916063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:15.934856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f77ad-d62a-4cc2-b24d-649eeaa0da62 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:15.981276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] MFA Rules not processed for user `737b2a5b21564d08ad5e4d5f11c009b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:15.982538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:16.006640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:16.021649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:16.023306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:16.023782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:16.024246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:16.105343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:16.107860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:16.133465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 817/1637] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:16.134441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:16.140755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 821/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:16.142340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:16.211654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90704-1b82-45dd-ba66-dd57fba87f2d service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:16.216121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ba03d-2bf9-455c-a270-963da366c209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:16.216951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba03d-2bf9-455c-a270-963da366c209 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:16.217391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba03d-2bf9-455c-a270-963da366c209 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:16.217799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba03d-2bf9-455c-a270-963da366c209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:16.253368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568d5fe-4bfc-4a09-a329-505947205673 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:16.263913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:16.267836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:16.268147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:16.268442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:16.281633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ba03d-2bf9-455c-a270-963da366c209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:16.283265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ba03d-2bf9-455c-a270-963da366c209 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:16.295739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:16.302707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:16.304936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 822/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:16.306590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c699b9-8644-45db-a02c-06b54f046ac4 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:16.308636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c699b9-8644-45db-a02c-06b54f046ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:16.309083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c699b9-8644-45db-a02c-06b54f046ac4 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:16.312363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 823/1640] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 6 11:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:16.319308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:16.319840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:16.320283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:16.340582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 818/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:16.355313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:16.357363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:16.369095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 824/1642] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:17.043304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:17.050326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:17.055211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8c790-80f3-4e47-b9a0-1be0d2f4de3e service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:17.079572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:17.080248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:17.080531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:17.080829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:17.101450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:17.105981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:17.122498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 819/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:17.191359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:17.219827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fce6-016d-433b-93f1-edb5585f83f7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:17.297541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:17.297541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:17.297541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:17.297541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:17.303949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:17.303949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:17.336642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 825/1644] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:18.276951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:18.405607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889921e-4729-4567-8103-bd7563f10d9a service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:18.412819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:18.413839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:18.414332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:18.414829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] PATH_INFO: `/v3/users/29e23a6520554348834454a31a95591f` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:18.416493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e23a6520554348834454a31a95591f)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:18.419139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:18.460051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:18.491263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a1fe-7e7f-4ed1-a06d-5c535a95b5a7 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:18.505996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:18.506837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:18.507939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:18.508530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] PATH_INFO: `/v3/users/beb78ae36e634dc3aab38916160e6275` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:18.512260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb78ae36e634dc3aab38916160e6275)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:18.517978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: WARNING py.warnings [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:48:18.517978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: warnings.warn(msg) Sep 06 11:48:18.517978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: Sep 06 11:48:18.520479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:18.531956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e23a6520554348834454a31a95591f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.533903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e23a6520554348834454a31a95591f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.551827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e23a6520554348834454a31a95591f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.588532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e23a6520554348834454a31a95591f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.591568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d7eee7f-ce14-4bda-b954-2af820e5d625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e23a6520554348834454a31a95591f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.625774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 820/1645] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:18 2022] DELETE /identity/v3/users/29e23a6520554348834454a31a95591f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:18.628484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:18.629937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:18.630240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:18.680105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:18.686051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:18.689782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:18.714017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb78ae36e634dc3aab38916160e6275'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.724118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb78ae36e634dc3aab38916160e6275'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.756350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb78ae36e634dc3aab38916160e6275'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.809178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb78ae36e634dc3aab38916160e6275'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.810953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-970c27f0-1b32-42f5-8f30-bf0e92fd7e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb78ae36e634dc3aab38916160e6275'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:18.854132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 826/1646] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:18 2022] DELETE /identity/v3/users/beb78ae36e634dc3aab38916160e6275 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:18.862130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:18.866141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:18.867909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:18.904902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 821/1647] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:18.923928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:18.924982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:18.992718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:18.994528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:19.032933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:19.085193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 827/1648] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:19.180945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:19.182416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:19.195724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707ada7-312f-4755-b96b-8eae233396d9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:19.360272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0215c0b-b0a4-4c31-a703-188f612dbe51 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:19.367104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:19.367735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:19.370337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:19.371373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:19.374915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:19.375761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:19.376887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:19.377791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:19.393052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:19.394732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:19.399379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:19.401912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:19.427325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 822/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:19.434525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 828/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:20.473082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:20.475818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:20.501654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471bc15-b295-4527-a578-8132ab6e2d33 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:20.513947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:20.514697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:20.514979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:20.515294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] PATH_INFO: `/v3/projects/7c3b0e90226245e58b81f2cdc9c2492e` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:20.518143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3b0e90226245e58b81f2cdc9c2492e)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:20.521536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: WARNING py.warnings [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:48:20.521536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: warnings.warn(msg) Sep 06 11:48:20.521536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: Sep 06 11:48:20.522906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:20.589922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:20.591819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:20.625115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49606b-e32e-446e-9cd7-399118b7036b service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:20.646552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:20.655518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:20.655821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:20.656087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] PATH_INFO: `/v3/users/4e30b4dc1b79465d97cbd20dbc5b8b0f` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:20.658952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e30b4dc1b79465d97cbd20dbc5b8b0f)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:20.669214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:20.716241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3b0e90226245e58b81f2cdc9c2492e', 'request_id': 'req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.752409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3b0e90226245e58b81f2cdc9c2492e', 'request_id': 'req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.777467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3b0e90226245e58b81f2cdc9c2492e', 'request_id': 'req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.860284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e30b4dc1b79465d97cbd20dbc5b8b0f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.861363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e30b4dc1b79465d97cbd20dbc5b8b0f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.863033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:20.867182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] The token cache is being invalidate because project 7c3b0e90226245e58b81f2cdc9c2492e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:20.872210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.874440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e30b4dc1b79465d97cbd20dbc5b8b0f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.877366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2132fcd2-bddf-4ed9-89ea-5dc5cb669da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.883143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 823/1651] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:20 2022] DELETE /identity/v3/projects/7c3b0e90226245e58b81f2cdc9c2492e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:20.887802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350b75-8a5a-4885-924a-2bc73624159e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:20.889677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350b75-8a5a-4885-924a-2bc73624159e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:20.890088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350b75-8a5a-4885-924a-2bc73624159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:20.915005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e30b4dc1b79465d97cbd20dbc5b8b0f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.916359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-1ee25e7c-a05d-4d61-b112-1a3803171596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e30b4dc1b79465d97cbd20dbc5b8b0f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:20.955616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 829/1652] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:20 2022] DELETE /identity/v3/users/4e30b4dc1b79465d97cbd20dbc5b8b0f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:20.957744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:20.958184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:20.958332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b2350b75-8a5a-4885-924a-2bc73624159e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:20.958669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:20.960255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b2350b75-8a5a-4885-924a-2bc73624159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.017487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:21.021540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.061149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:21.090268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 824/1653] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:21.101556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f054-604d-499f-ab61-e465c1978829 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.103422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f054-604d-499f-ab61-e465c1978829 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.105119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f054-604d-499f-ab61-e465c1978829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.127156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 830/1654] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:21.139251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.140736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.159395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-be11f054-604d-499f-ab61-e465c1978829 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:21.162270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-be11f054-604d-499f-ab61-e465c1978829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.182165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 825/1655] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:21.186618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11f054-604d-499f-ab61-e465c1978829 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.210748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11f054-604d-499f-ab61-e465c1978829 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.221712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.223116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.223405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.223683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.224365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:21.224675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.226352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.257670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 826/1656] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:21.259722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.289124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0df2d-669e-4108-9305-faf060f6acbe admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.301128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.301768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.302048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.302466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.303355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.305157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.350022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb879ff-ef78-45f6-8833-19abd70c75ee None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.360455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.361125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.361411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.361688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.371902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 827/1657] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:21 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:21.373050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.384559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.385989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.386098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.410313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 831/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:21.411583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.432632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde25178-bf89-4688-a965-a4b2862dc61f service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.545139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce6eb7-1ece-47bc-89d9-3195cc9778b8 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.571535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.572474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.572998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.573477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] PATH_INFO: `/v3/projects/bbe5dfa9163b4ec0858cd209522258f5` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.574997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe5dfa9163b4ec0858cd209522258f5)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.577163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.629748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.630398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.630698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.630974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.631622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.633586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.695494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:21.723409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 832/1659] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:21 2022] POST /identity/v3/users => generated 282 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:21.728156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.739581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe5dfa9163b4ec0858cd209522258f5', 'request_id': 'req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:21.755055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe5dfa9163b4ec0858cd209522258f5', 'request_id': 'req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:21.756968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f25695-54d2-45d0-b083-60c31e86c08f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.778039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe5dfa9163b4ec0858cd209522258f5', 'request_id': 'req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:21.819283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] The token cache is being invalidate because project bbe5dfa9163b4ec0858cd209522258f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:21.819805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:21.822584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:21.829270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 828/1660] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:21 2022] DELETE /identity/v3/projects/bbe5dfa9163b4ec0858cd209522258f5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:21.830925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.836602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.925034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.928798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.930838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.931261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.934145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.945675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:21.946900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.988093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 833/1661] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:21.998517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.007982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:22.042512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148f5dc-b2ac-4b86-8b03-34ae1fed8ffb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.061858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.063144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.064143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.064143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] PATH_INFO: `/v3/users/737b2a5b21564d08ad5e4d5f11c009b8` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.068299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891533c-1197-4571-b9f9-f5265c101962 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.071176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737b2a5b21564d08ad5e4d5f11c009b8)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.074889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.093416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.094187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.094414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.094716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.095364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.096986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.165059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 834/1662] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:22.166373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.199175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979ccc-4c8e-4afb-85bf-b6f519c9cc10 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.215565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1edc86-a891-4a43-8e2d-6d7aaf0994c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.216255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1edc86-a891-4a43-8e2d-6d7aaf0994c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.216616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1edc86-a891-4a43-8e2d-6d7aaf0994c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.217318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1edc86-a891-4a43-8e2d-6d7aaf0994c6 admin admin] PATH_INFO: `/v3/projects/f98d0d52188b49fe9ce71b3e8e972bc3/users/f0ef4bdda1d848a3a71cf498ee6021a9/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.250151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737b2a5b21564d08ad5e4d5f11c009b8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.265628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737b2a5b21564d08ad5e4d5f11c009b8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.274733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1edc86-a891-4a43-8e2d-6d7aaf0994c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98d0d52188b49fe9ce71b3e8e972bc3, user_id=f0ef4bdda1d848a3a71cf498ee6021a9, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.278005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1edc86-a891-4a43-8e2d-6d7aaf0994c6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.300815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737b2a5b21564d08ad5e4d5f11c009b8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.322218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 835/1663] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:22 2022] PUT /identity/v3/projects/f98d0d52188b49fe9ce71b3e8e972bc3/users/f0ef4bdda1d848a3a71cf498ee6021a9/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:22.324160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.325572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.326174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.349208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737b2a5b21564d08ad5e4d5f11c009b8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.350227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737b2a5b21564d08ad5e4d5f11c009b8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.381343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 829/1664] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:21 2022] DELETE /identity/v3/users/737b2a5b21564d08ad5e4d5f11c009b8 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:22.405871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] MFA Rules not processed for user `f0ef4bdda1d848a3a71cf498ee6021a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:22.411810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:22.595521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 836/1665] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:22.600233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.602765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:22.629527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.631552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:22.753329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:22.785074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec490-b22e-4af9-b15d-4f94af6e6c7c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.797201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.802326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368f58-2bc8-4119-9a36-02a598d330b0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.807984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.808265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.808539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] PATH_INFO: `/v3/projects/2bfd839a8d424c6a838ef2c15ed4a7f8` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.811112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfd839a8d424c6a838ef2c15ed4a7f8)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.813631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.826972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.843042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.843615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.844832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.845781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.848090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.914754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 830/1666] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:22 2022] POST /identity/v3/projects => generated 365 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:22.919004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.919148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfd839a8d424c6a838ef2c15ed4a7f8', 'request_id': 'req-df869fbd-d720-47b0-9ff8-2c7879724e29'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.929910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfd839a8d424c6a838ef2c15ed4a7f8', 'request_id': 'req-df869fbd-d720-47b0-9ff8-2c7879724e29'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.950793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfd839a8d424c6a838ef2c15ed4a7f8', 'request_id': 'req-df869fbd-d720-47b0-9ff8-2c7879724e29'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.971365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] The token cache is being invalidate because project 2bfd839a8d424c6a838ef2c15ed4a7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:22.971684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.972637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-df869fbd-d720-47b0-9ff8-2c7879724e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:22.975071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 837/1667] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:22 2022] DELETE /identity/v3/projects/2bfd839a8d424c6a838ef2c15ed4a7f8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:22.996562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:22.998442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3c1f-61a9-41d8-a32c-3beedff9751c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.999144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3c1f-61a9-41d8-a32c-3beedff9751c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.000577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3c1f-61a9-41d8-a32c-3beedff9751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.018298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c495f7f-bbaf-4c93-82c6-f7b4f6bfe05c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.037540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.038512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.039058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.040141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.041000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.048995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.077818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-536d3c1f-61a9-41d8-a32c-3beedff9751c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:23.080773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-536d3c1f-61a9-41d8-a32c-3beedff9751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:23.094895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 831/1668] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:22 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:23.097333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 838/1669] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:23.098609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.101393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:23.105289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.105575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.105847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.140315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fb10-267f-4b88-aef1-3233bb494e62 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.142884 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:23.145804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.146607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.146790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:23.147277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.147654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.148490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.151176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.174738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 832/1670] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:48:23.180282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.188866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 839/1671] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:23.193973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.205589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971b9b8-13ad-44ed-bde5-606acf28d81a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.209749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7815c4-1b5e-44b9-a517-a5043d5683cf admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.221411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.222025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.222302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.222514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.222600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.223313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.223546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:23.226381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.226381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] PATH_INFO: `/v3/projects/d43e3648c6c64dbea7e10ca843b2fc7a/users/fb5c65894d5948ba94f7005da167cd75/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.226775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.229649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.259732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43e3648c6c64dbea7e10ca843b2fc7a, user_id=fb5c65894d5948ba94f7005da167cd75, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.266537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.274764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 840/1672] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:23.276256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.299817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 833/1673] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:23 2022] PUT /identity/v3/projects/d43e3648c6c64dbea7e10ca843b2fc7a/users/fb5c65894d5948ba94f7005da167cd75/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:23.301087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.310550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da34c3-9b84-4e6e-8b47-674a5ba46d5d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.462620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.463304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.463579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.463850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.464497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.466512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.501251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee344f5-50b7-466c-a92b-56d02d9bc275 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.521316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.524262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.524262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.524553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.526082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.528658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.547415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 841/1674] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:23 2022] POST /identity/v3/projects => generated 365 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:23.551454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.556000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 834/1675] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:23.558048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.601339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:23.602337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a30a9e-b1fb-473c-b387-9c23e9e76f63 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.659088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8b4e5-604b-43cd-bd47-0246a41201ef admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.665155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.665910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.666253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.666594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.668308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.670624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.703840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 842/1676] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:23 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:23.709291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.729254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8deb80-59a0-455c-a2b6-0de005a10a8c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.742427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.742837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.743513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.744377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.747681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.751862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.785184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 843/1677] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:23.793498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.804679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d81103-2dad-4855-b067-205a7d24abaf admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.812662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.813885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.813885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.814047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.815030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.816873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.831251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 844/1678] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:23.835162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1530-82d3-4fc2-9ec2-f60f5ef32929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.835966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1530-82d3-4fc2-9ec2-f60f5ef32929 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.836251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1530-82d3-4fc2-9ec2-f60f5ef32929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.836531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1530-82d3-4fc2-9ec2-f60f5ef32929 admin admin] PATH_INFO: `/v3/projects/d43e3648c6c64dbea7e10ca843b2fc7a/users/fb5c65894d5948ba94f7005da167cd75/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.836637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.853417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1530-82d3-4fc2-9ec2-f60f5ef32929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43e3648c6c64dbea7e10ca843b2fc7a, user_id=fb5c65894d5948ba94f7005da167cd75, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.856568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1530-82d3-4fc2-9ec2-f60f5ef32929 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.857676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9bb1-2e8d-45b8-9331-127d930c5a6c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:23.865783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:23.867059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.867472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.867919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] PATH_INFO: `/v3/projects/815b9b50ed4648ec8625eb06cf15b10a/users/93fe46df94a948419afd8102bb761b60/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.903488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 835/1679] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:23 2022] PUT /identity/v3/projects/d43e3648c6c64dbea7e10ca843b2fc7a/users/fb5c65894d5948ba94f7005da167cd75/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:23.912779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee228b-242e-40fc-acb7-1784c214d814 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:23.913066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee228b-242e-40fc-acb7-1784c214d814 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:23.913344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee228b-242e-40fc-acb7-1784c214d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:23.915441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815b9b50ed4648ec8625eb06cf15b10a, user_id=93fe46df94a948419afd8102bb761b60, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:23.920778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:23.947689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 845/1680] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:23 2022] PUT /identity/v3/projects/815b9b50ed4648ec8625eb06cf15b10a/users/93fe46df94a948419afd8102bb761b60/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:23.948741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:23.950518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.012221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-81ee228b-242e-40fc-acb7-1784c214d814 None None] MFA Rules not processed for user `fb5c65894d5948ba94f7005da167cd75`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:24.017155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-81ee228b-242e-40fc-acb7-1784c214d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.084021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:24.108191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac74bf-b58f-4bdb-96a1-8054fb58dfc8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:24.121380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:24.122051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.122330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.122604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] PATH_INFO: `/v3/users/11c7d6d81ffd45ad8468d3f6a05de4e2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.125737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c7d6d81ffd45ad8468d3f6a05de4e2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:24.127746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:24.230231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 836/1681] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:24.235508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c7d6d81ffd45ad8468d3f6a05de4e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:24.237515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c7d6d81ffd45ad8468d3f6a05de4e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:24.237702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303554f6-fa3b-488b-82c3-93769c391686 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.238109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303554f6-fa3b-488b-82c3-93769c391686 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.238638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303554f6-fa3b-488b-82c3-93769c391686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.257078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c7d6d81ffd45ad8468d3f6a05de4e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:24.291255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c7d6d81ffd45ad8468d3f6a05de4e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:24.292136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c7d6d81ffd45ad8468d3f6a05de4e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:24.308904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:24.310575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-303554f6-fa3b-488b-82c3-93769c391686 None None] MFA Rules not processed for user `93fe46df94a948419afd8102bb761b60`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:24.311946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-303554f6-fa3b-488b-82c3-93769c391686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.319858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 846/1682] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:23 2022] DELETE /identity/v3/users/11c7d6d81ffd45ad8468d3f6a05de4e2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:24.321975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:24.324629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.412278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9bb14-60b3-43d0-9461-9bb65d306f44 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:24.417626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:24.418417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.418835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.419208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.425316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.480208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 837/1683] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:24.480208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6d46f-9de3-419f-a4fe-7a57d4efb698 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.480208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6d46f-9de3-419f-a4fe-7a57d4efb698 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.480208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6d46f-9de3-419f-a4fe-7a57d4efb698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.519755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-eda6d46f-9de3-419f-a4fe-7a57d4efb698 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:24.521012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-eda6d46f-9de3-419f-a4fe-7a57d4efb698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.523898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:24.525603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:24.540280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 847/1684] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:24.541415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:24.542895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.561692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae041-ca21-4d43-8158-a859a3ec7fd7 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:24.566824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:24.567630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.567987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.568323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.651998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:24.653565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:24.677312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 838/1685] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:24.679302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 848/1686] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:24.682506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0323-5309-4616-bf8b-8a73f9f08296 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.682827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0323-5309-4616-bf8b-8a73f9f08296 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.683241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0323-5309-4616-bf8b-8a73f9f08296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.760202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:24.769868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f2f7e-680d-4f75-b37d-76f140d1d5de service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:24.776381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5b3b0323-5309-4616-bf8b-8a73f9f08296 None None] MFA Rules not processed for user `fbab55a55b194d2fb5a3837e3ff758fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:24.777852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5b3b0323-5309-4616-bf8b-8a73f9f08296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.778804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:24.783940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.783940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.783940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.790829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.880127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:24.895868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:24.913931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:24.916083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:24.929586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 849/1687] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:24.932173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:24.934539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.944923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 839/1688] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:24.956029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.956481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.956998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.993274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] MFA Rules not processed for user `fbab55a55b194d2fb5a3837e3ff758fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:24.994558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:25.013072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 840/1689] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:25.027396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:25.029089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:25.096054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e2627-13b7-4624-8e6e-0596abe70edf service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:25.112083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:25.112741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.113082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.115168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.138786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:25.141059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:25.169414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 850/1690] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:25.196122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:25.198571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:25.226546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0fbf-f292-40f4-be8b-fae663851e6a service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:25.257151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:25.259589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.260001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.260463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] PATH_INFO: `/v3/projects/780b6ddd322a4020bf3847c991b5af77` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.264366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] RBAC: Authorizing `identity:delete_project(project_id=780b6ddd322a4020bf3847c991b5af77)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:25.272572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:25.276601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2acf26-f904-4eea-b61f-262ba6ce8061 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:25.285943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae03ab-b6b7-451b-b2f4-0c5a3cea7825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:25.293980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae03ab-b6b7-451b-b2f4-0c5a3cea7825 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.295284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae03ab-b6b7-451b-b2f4-0c5a3cea7825 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.295563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae03ab-b6b7-451b-b2f4-0c5a3cea7825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.315853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae03ab-b6b7-451b-b2f4-0c5a3cea7825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:25.317799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae03ab-b6b7-451b-b2f4-0c5a3cea7825 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:25.357112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 841/1691] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:25.432130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780b6ddd322a4020bf3847c991b5af77', 'request_id': 'req-dfffeb67-4bf4-4a12-840b-ba389c58401c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.459454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780b6ddd322a4020bf3847c991b5af77', 'request_id': 'req-dfffeb67-4bf4-4a12-840b-ba389c58401c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.485981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780b6ddd322a4020bf3847c991b5af77', 'request_id': 'req-dfffeb67-4bf4-4a12-840b-ba389c58401c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.517566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] The token cache is being invalidate because project 780b6ddd322a4020bf3847c991b5af77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:25.522541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.524587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.551292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 851/1692] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:25 2022] DELETE /identity/v3/projects/780b6ddd322a4020bf3847c991b5af77 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:25.556859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4e1c9-4fae-4e2e-927d-6167957a9f50 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.557227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4e1c9-4fae-4e2e-927d-6167957a9f50 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.557524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4e1c9-4fae-4e2e-927d-6167957a9f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.600841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a3b4e1c9-4fae-4e2e-927d-6167957a9f50 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:25.612098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a3b4e1c9-4fae-4e2e-927d-6167957a9f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:25.622413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:25.624102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:25.817167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 842/1693] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:25.828886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.829351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.829752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.843491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffeb67-4bf4-4a12-840b-ba389c58401c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:25.858915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:25.859969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.860381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.860783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] PATH_INFO: `/v3/users/b96b1bf4594d47339e57fd4b121c3dff` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.862949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96b1bf4594d47339e57fd4b121c3dff)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:25.865023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:25.866003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:25.869709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:25.894518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:25.898719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 843/1694] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:25.900625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:25.913705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682f85d-a87e-4e35-b167-18c593c6b018 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:25.925515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:25.926261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:25.926635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:25.939224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:25.940139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:25.940613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:25.942398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:25.962309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 844/1695] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:48:25.966803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:25.970371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96b1bf4594d47339e57fd4b121c3dff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.971323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96b1bf4594d47339e57fd4b121c3dff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.979871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96b1bf4594d47339e57fd4b121c3dff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.995772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96b1bf4594d47339e57fd4b121c3dff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:25.996811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-7a9b2ffd-f13b-4a77-8bd3-f07c68b0873f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96b1bf4594d47339e57fd4b121c3dff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:26.001036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713b709-3bd9-4e72-ab03-b71770db4393 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.009923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.010748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.011061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.011528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.012566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.015355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.027670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 852/1696] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:25 2022] DELETE /identity/v3/users/b96b1bf4594d47339e57fd4b121c3dff => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:26.032606 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.032889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.034019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.071821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:26.075459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:26.089015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 845/1697] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:25 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:26.092824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.096310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:26.135886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:26.220027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 853/1698] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:26.248468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.250471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:26.258641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832581-0b77-4eb9-ac05-eed53df33c53 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.282631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d921d-e6d3-4fb9-a2f8-b28e736b39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.283367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d921d-e6d3-4fb9-a2f8-b28e736b39e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.286320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d921d-e6d3-4fb9-a2f8-b28e736b39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.286616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d921d-e6d3-4fb9-a2f8-b28e736b39e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.287319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d921d-e6d3-4fb9-a2f8-b28e736b39e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.289420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d921d-e6d3-4fb9-a2f8-b28e736b39e8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.375853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 846/1699] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:26 2022] POST /identity/v3/users => generated 283 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:26.375853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1b7e-7dd1-42cf-8296-f9c864b32bb4 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.376565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1b7e-7dd1-42cf-8296-f9c864b32bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.376872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b1b7e-7dd1-42cf-8296-f9c864b32bb4 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.378182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 847/1700] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 6 11:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:26.378924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1b7e-7dd1-42cf-8296-f9c864b32bb4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.409007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b1b7e-7dd1-42cf-8296-f9c864b32bb4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.419886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44be5ea-e678-4078-8b6a-92dec9270fff None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.422219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f106d6-042a-4376-9149-4c65d2fa0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.422452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f106d6-042a-4376-9149-4c65d2fa0014 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.423185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f106d6-042a-4376-9149-4c65d2fa0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.423590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f106d6-042a-4376-9149-4c65d2fa0014 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.424250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f106d6-042a-4376-9149-4c65d2fa0014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.427004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f106d6-042a-4376-9149-4c65d2fa0014 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.432036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.432664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.432935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.433196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.449847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.451267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.459742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 848/1701] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:26.461339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.461783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.462057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.478103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 854/1702] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:26.481695 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.502177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b443-0352-4f29-9fff-27ffea7981d2 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.518056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.518795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.519065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.522285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.523928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.525818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.558743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:26.560662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:26.561010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 855/1703] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:26.561978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.588181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 849/1704] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:26.597397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97776c41-df2f-4a03-b1ad-1df742d76736 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.608959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694030c5-88f0-4f31-b4bc-ef4f914e3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.609854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694030c5-88f0-4f31-b4bc-ef4f914e3d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.610437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694030c5-88f0-4f31-b4bc-ef4f914e3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.610437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694030c5-88f0-4f31-b4bc-ef4f914e3d56 admin admin] PATH_INFO: `/v3/projects/9dc3bed14de5461dbd0398705b588704/users/d9663efb12c049da869ca0ce98427545/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.624011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.639316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c425ff-349d-4ebf-8ee6-134922ce7e11 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.649980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694030c5-88f0-4f31-b4bc-ef4f914e3d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc3bed14de5461dbd0398705b588704, user_id=d9663efb12c049da869ca0ce98427545, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.656008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694030c5-88f0-4f31-b4bc-ef4f914e3d56 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.663541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.664404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.664782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.665188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.680472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:26.684452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.686261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.693297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 856/1705] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:26 2022] PUT /identity/v3/projects/9dc3bed14de5461dbd0398705b588704/users/d9663efb12c049da869ca0ce98427545/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:26.705599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.705893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.708588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.726455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 850/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:26.771533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] MFA Rules not processed for user `d9663efb12c049da869ca0ce98427545`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:26.772782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:26.905706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 857/1707] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:26.910526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.931452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f285-8b1f-444a-a987-322e5b9946e3 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.055418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.059416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:27.106531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.107210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.107489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.107763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.110794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.115463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.163937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae391e-f813-4624-999c-72c2de5ff759 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.172268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.174440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.174440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.178828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] PATH_INFO: `/v3/projects/7fdde022bb7d463dba7d00639765fb8a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.181622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdde022bb7d463dba7d00639765fb8a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.185119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.211444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 851/1708] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:26 2022] POST /identity/v3/projects => generated 363 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:27.216348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.290599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:27.335159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c91b5-fdba-4773-8c74-e99024c091ed admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.341515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.342529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.343050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.343599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.344342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.351038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.407826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdde022bb7d463dba7d00639765fb8a', 'request_id': 'req-b6e7fb42-3831-4a14-a215-0d9aa521e660'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.439004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdde022bb7d463dba7d00639765fb8a', 'request_id': 'req-b6e7fb42-3831-4a14-a215-0d9aa521e660'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.447451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 852/1709] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:27 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:27.448469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.461268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82414ac-49c0-42b3-9099-866c781274c0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.470969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdde022bb7d463dba7d00639765fb8a', 'request_id': 'req-b6e7fb42-3831-4a14-a215-0d9aa521e660'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.508950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] The token cache is being invalidate because project 7fdde022bb7d463dba7d00639765fb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:27.510318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.511972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.529681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 858/1710] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:27 2022] DELETE /identity/v3/projects/7fdde022bb7d463dba7d00639765fb8a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:27.532341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.537166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:27.621579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:27.703139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.703842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.704121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.704651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.705456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.726579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.752568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 853/1711] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:27.753761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.756016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:27.766500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7fb42-3831-4a14-a215-0d9aa521e660 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.778865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3797c-9938-4e26-b767-47be82376452 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.779566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.781130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.781561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.782098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] PATH_INFO: `/v3/users/7f64e34f033f4ea7a5387591544917ad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.784283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f64e34f033f4ea7a5387591544917ad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.785247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.786099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.786539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.786993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] PATH_INFO: `/v3/projects/6222bee983004225ad357302ea1e75c4/users/3999d32f6b1846aa9e540474166b320b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.790978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.825478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6222bee983004225ad357302ea1e75c4, user_id=3999d32f6b1846aa9e540474166b320b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.829451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.855113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 854/1712] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:27 2022] PUT /identity/v3/projects/6222bee983004225ad357302ea1e75c4/users/3999d32f6b1846aa9e540474166b320b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:27.861080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.888410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f64e34f033f4ea7a5387591544917ad'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.889172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f64e34f033f4ea7a5387591544917ad'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.901269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f64e34f033f4ea7a5387591544917ad'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.917646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f64e34f033f4ea7a5387591544917ad'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.920746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f64e34f033f4ea7a5387591544917ad'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.961986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 859/1713] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:27 2022] DELETE /identity/v3/users/7f64e34f033f4ea7a5387591544917ad => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:28.005567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31aef-9019-475e-8548-1331b03fbd72 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:28.111679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:28.127300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf7c4-266d-419e-bce0-de5a1e6a2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:28.128475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf7c4-266d-419e-bce0-de5a1e6a2e3d admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.136521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf7c4-266d-419e-bce0-de5a1e6a2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.136868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf7c4-266d-419e-bce0-de5a1e6a2e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.137655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf7c4-266d-419e-bce0-de5a1e6a2e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:28.139451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf7c4-266d-419e-bce0-de5a1e6a2e3d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:28.155263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 855/1714] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:28.161031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:28.165681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:28.208953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9862df-f8d5-4766-a93e-44c806493802 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:28.249759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:28.252377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.252684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.252968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] PATH_INFO: `/v3/projects/6222bee983004225ad357302ea1e75c4/users/3999d32f6b1846aa9e540474166b320b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.268938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6222bee983004225ad357302ea1e75c4, user_id=3999d32f6b1846aa9e540474166b320b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:28.282370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:28.339808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 860/1715] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:28 2022] PUT /identity/v3/projects/6222bee983004225ad357302ea1e75c4/users/3999d32f6b1846aa9e540474166b320b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:28.340015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058c8d-b30f-41f8-9f3e-bc2ae3da75d2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.340256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058c8d-b30f-41f8-9f3e-bc2ae3da75d2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.340525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058c8d-b30f-41f8-9f3e-bc2ae3da75d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.412155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d4058c8d-b30f-41f8-9f3e-bc2ae3da75d2 None None] MFA Rules not processed for user `3999d32f6b1846aa9e540474166b320b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:28.413407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d4058c8d-b30f-41f8-9f3e-bc2ae3da75d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:28.562341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 856/1716] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:28.575425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:28.577491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:28.791904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a7e0d-9ebb-41c0-82b7-edd28f3ae991 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:28.797620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:28.799889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.803395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.803860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.828948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:28.835267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:28.855091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.855620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.856119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.862146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 861/1717] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:28.931668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] MFA Rules not processed for user `2c55486a82b54091ad04eaa32fdd3a36`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:28.933649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.096606 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.098175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.256192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:29.301577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 857/1718] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:29.307615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.309629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.397834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde4c0c-0a8a-4422-8735-747d74206fc3 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.419903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.422294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.422581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.422885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.433887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.501649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.509054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.552304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 862/1719] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:29.553294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.556510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.573354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:29.585485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e4bf0-41f6-4518-ad47-b9543f2eddde None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.610228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.610964 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.611249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.611576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.630206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.635641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.672722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 858/1720] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:29.714587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.716610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.827512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8eb9-39fa-46e0-a18f-8d9bcd8a9339 service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.843421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.846298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.846827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.847300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] PATH_INFO: `/v3/projects/48a766ebf062434496650429c5d35499` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.858506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a766ebf062434496650429c5d35499)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.858506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.946081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93550a0c-cc67-4f3e-9e64-59fc0e3f200a service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.952784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.953511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.953848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.954162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] PATH_INFO: `/v3/projects/570e0b9927bd4f72bfc7573a7a7cccfe` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.955535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570e0b9927bd4f72bfc7573a7a7cccfe)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.958234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.999402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a766ebf062434496650429c5d35499', 'request_id': 'req-71648144-e055-409a-9415-e76514f1ff7f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.022201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a766ebf062434496650429c5d35499', 'request_id': 'req-71648144-e055-409a-9415-e76514f1ff7f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.037946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a766ebf062434496650429c5d35499', 'request_id': 'req-71648144-e055-409a-9415-e76514f1ff7f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.043350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570e0b9927bd4f72bfc7573a7a7cccfe', 'request_id': 'req-cc3b0837-7a35-4e83-8174-b45627661e97'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.053872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570e0b9927bd4f72bfc7573a7a7cccfe', 'request_id': 'req-cc3b0837-7a35-4e83-8174-b45627661e97'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.070618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] The token cache is being invalidate because project 48a766ebf062434496650429c5d35499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:30.071263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.073789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-71648144-e055-409a-9415-e76514f1ff7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.074498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570e0b9927bd4f72bfc7573a7a7cccfe', 'request_id': 'req-cc3b0837-7a35-4e83-8174-b45627661e97'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.080846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 863/1721] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:29 2022] DELETE /identity/v3/projects/48a766ebf062434496650429c5d35499 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:30.087319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424aac-a68f-4fe7-bc2e-35afb28d6034 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.087926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424aac-a68f-4fe7-bc2e-35afb28d6034 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.088040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424aac-a68f-4fe7-bc2e-35afb28d6034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.120368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] The token cache is being invalidate because project 570e0b9927bd4f72bfc7573a7a7cccfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:30.123061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.134966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:30.140357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 859/1722] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:29 2022] DELETE /identity/v3/projects/570e0b9927bd4f72bfc7573a7a7cccfe => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:30.142251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:30.146711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.201555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3c424aac-a68f-4fe7-bc2e-35afb28d6034 None None] MFA Rules not processed for user `6f56d81c90714d7584d80cf3fb1d4075`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:30.204610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3c424aac-a68f-4fe7-bc2e-35afb28d6034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.338127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:30.354340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0837-7a35-4e83-8174-b45627661e97 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:30.362221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:30.363323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.363741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.364148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.369777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.445950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 864/1723] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:30.455363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c0d62-df4b-416e-99c1-2eec05b6d527 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.455363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c0d62-df4b-416e-99c1-2eec05b6d527 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.455363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c0d62-df4b-416e-99c1-2eec05b6d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.485320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:30.499081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ed0c0d62-df4b-416e-99c1-2eec05b6d527 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:30.501405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ed0c0d62-df4b-416e-99c1-2eec05b6d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.552143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:30.566801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45e85-3659-44ab-a399-2accb234a400 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:30.606873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 860/1724] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:30.622598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.624707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.626362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.641061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 865/1725] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:30.641061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195c28-135a-41b3-bd2b-07e46a432f5d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.641061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195c28-135a-41b3-bd2b-07e46a432f5d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.641061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195c28-135a-41b3-bd2b-07e46a432f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.677754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3d195c28-135a-41b3-bd2b-07e46a432f5d None None] MFA Rules not processed for user `6f56d81c90714d7584d80cf3fb1d4075`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:30.679389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3d195c28-135a-41b3-bd2b-07e46a432f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.697422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:30.698782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.710239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 866/1726] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:30.710239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2324-5925-46f9-8479-f02754e60bdb None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.710239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2324-5925-46f9-8479-f02754e60bdb None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.710239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2324-5925-46f9-8479-f02754e60bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.728130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 861/1727] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:30.733368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:30.740625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.800038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-64cd2324-5925-46f9-8479-f02754e60bdb None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:30.808150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-64cd2324-5925-46f9-8479-f02754e60bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.856499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 867/1728] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:30.860392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:30.862298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:30.862593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:30.928365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:30.935028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:30.962157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 868/1729] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:30.966311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:30.998149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6e0f-41d5-461c-8be5-092937907ac5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.010819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.011624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.012006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.012552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.014629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:31.016416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.020472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.051643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae330e2-6789-4f91-a19e-2578fc00102b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.068893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 869/1730] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:31.074092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.074726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.075117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.075226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.075489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.090234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cd120-d72c-4270-a7f5-588ddc7636a5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.102290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.103267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.104863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.105596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.105713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.106650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:31.107348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.107642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.109612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.138422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 862/1731] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:31.139359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.153718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 870/1732] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:31.157169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.179424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b69ab-639b-4ea7-8ad9-83a819ac1491 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.190804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b41e-d2ba-4e74-a7e0-a8290f9ce92a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.208775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.209208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.209490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.209754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.210600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.215873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.216692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.217077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.217449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.218305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.221710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.222205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.318248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 863/1733] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:31 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:31.321072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.321393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 871/1734] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:31 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:31.325563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.560167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02263a-4700-46f2-a472-f03334967da6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.588289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.588523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.588781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.589194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.589705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.595859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.645935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:31.650816 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 872/1735] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:31 2022] POST /identity/v3/users => generated 294 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:31.654618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.672695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1570b7-2e16-42c2-ae09-48b4ac14ac4a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.686013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490ca0-c18a-4c2f-a095-3fa99adbd155 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.700182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.700942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.701323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.701711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.702192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.702863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.703230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.703447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.703548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.704102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.717813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.725727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.776324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 873/1736] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:31.791763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.827300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 864/1737] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:31 2022] POST /identity/v3/users => generated 303 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:31.831401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414fe22-85a1-4306-8417-64d8a2c2b897 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.840850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.848045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.848813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.854785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.856498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.857311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.868318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.890359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc108-acf4-49f3-b44d-69343dea9781 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.906652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 874/1738] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:31.907461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.908114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.908392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.909974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.914795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:31.915626 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:31.917279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:31.954221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355d61-8d5a-43c5-8b35-2d1b56766a50 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:31.955431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 865/1739] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:31.959846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:31.977084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189e7ec-0edf-40c9-bcaa-5b8ae5ebc840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:31.977784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e7ec-0edf-40c9-bcaa-5b8ae5ebc840 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:31.978066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e7ec-0edf-40c9-bcaa-5b8ae5ebc840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:31.978338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e7ec-0edf-40c9-bcaa-5b8ae5ebc840 admin admin] PATH_INFO: `/v3/projects/3fddd18850ee49eeb7a0fe1af1a337db/users/b7e36c577f004d12a0fc4b4c7726dcc4/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.002341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6420-f906-43f5-9c73-c6c7ec71f843 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:32.024307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffb153-8f6d-449f-8b6d-e4b5ceddcbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:32.024981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb153-8f6d-449f-8b6d-e4b5ceddcbbe admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.025259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb153-8f6d-449f-8b6d-e4b5ceddcbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.025553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb153-8f6d-449f-8b6d-e4b5ceddcbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.026208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffb153-8f6d-449f-8b6d-e4b5ceddcbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:32.027956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffb153-8f6d-449f-8b6d-e4b5ceddcbbe admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:32.044052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:32.047438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189e7ec-0edf-40c9-bcaa-5b8ae5ebc840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fddd18850ee49eeb7a0fe1af1a337db, user_id=b7e36c577f004d12a0fc4b4c7726dcc4, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:32.050239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189e7ec-0edf-40c9-bcaa-5b8ae5ebc840 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:32.085641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 866/1740] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:32.087625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5129a-0c5a-46a0-92fe-4dc8fd6ef854 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.087916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5129a-0c5a-46a0-92fe-4dc8fd6ef854 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.088216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5129a-0c5a-46a0-92fe-4dc8fd6ef854 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.096898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 867/1741] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 6 11:48:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:32.098275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5129a-0c5a-46a0-92fe-4dc8fd6ef854 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:32.105602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 875/1742] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:31 2022] PUT /identity/v3/projects/3fddd18850ee49eeb7a0fe1af1a337db/users/b7e36c577f004d12a0fc4b4c7726dcc4/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:32.116501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c79d-32b7-4197-ba33-e436fd4aebf6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.116787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c79d-32b7-4197-ba33-e436fd4aebf6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.117059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c79d-32b7-4197-ba33-e436fd4aebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.213135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-9a18c79d-32b7-4197-ba33-e436fd4aebf6 None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:32.214372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9a18c79d-32b7-4197-ba33-e436fd4aebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:32.279865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5129a-0c5a-46a0-92fe-4dc8fd6ef854 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:32.315174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:32.315878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.316163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.316441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] PATH_INFO: `/v3/projects/086a2ec783ff4c119cad7044c455c280/users/0b470479df27467c865a3b99b7554759/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.371017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] RBAC: Authorizing `identity:create_grant(project_id=086a2ec783ff4c119cad7044c455c280, user_id=0b470479df27467c865a3b99b7554759, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:32.376841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:32.388424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 876/1743] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:32.396916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.397221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.397480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.404021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 868/1744] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:32 2022] PUT /identity/v3/projects/086a2ec783ff4c119cad7044c455c280/users/0b470479df27467c865a3b99b7554759/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:32.409638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:32.411915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:32.502097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] MFA Rules not processed for user `b7e36c577f004d12a0fc4b4c7726dcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:32.502097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:32.506205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10364cc-1dc5-45b3-ae6f-a2423b1d396b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:32.510256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab54412-6811-41b3-96af-edecd6bb298e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:32.511085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54412-6811-41b3-96af-edecd6bb298e service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.511465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54412-6811-41b3-96af-edecd6bb298e service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.511804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54412-6811-41b3-96af-edecd6bb298e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.541485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54412-6811-41b3-96af-edecd6bb298e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:32.544601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54412-6811-41b3-96af-edecd6bb298e service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:32.571238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 869/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:32.575427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.575733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.575989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.643691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:32.651080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:32.717473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 877/1746] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:32.723331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:32.840140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 870/1747] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:32.879670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:32.893594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:32.897945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59196f-8e70-4118-90cf-bd7788ea330d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:32.911557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:32.916749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.917143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.917492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.945296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4774b2-2505-4899-8eb6-c0457e9065da None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:32.957045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:32.959349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:32.965978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:32.969643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:32.970247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:32.971511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:32.971903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:32.986419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:33.003776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 871/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:33.075079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 878/1749] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:32 2022] POST /identity/v3/projects => generated 389 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:33.076581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:33.108619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2916178-c7dd-4da9-a0e6-edbee3d9d431 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:33.132859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:33.255810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:33.256597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:33.256831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:33.257110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:33.257877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:33.261799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:33.312651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 872/1750] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:33 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:33.316952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:33.365780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9c15-90b3-4fe3-9d12-12bb48399db8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:33.385733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:33.388310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:33.391368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:33.392547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:33.397012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:33.404957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:33.454277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 879/1751] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:33.457713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:33.516997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec1cd5-922c-48d3-ba5e-e2bb365f8777 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:33.563233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0431f0-66f1-4db6-8520-93756adecb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:33.564108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0431f0-66f1-4db6-8520-93756adecb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:33.569164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0431f0-66f1-4db6-8520-93756adecb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:33.573501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0431f0-66f1-4db6-8520-93756adecb7d admin admin] PATH_INFO: `/v3/projects/a536edaccd81491eaa7e81e42084089a/users/a3e92a11a89846938f834dcb98d17a17/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:33.635599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0431f0-66f1-4db6-8520-93756adecb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a536edaccd81491eaa7e81e42084089a, user_id=a3e92a11a89846938f834dcb98d17a17, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:33.650873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0431f0-66f1-4db6-8520-93756adecb7d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:33.685040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 873/1752] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:33 2022] PUT /identity/v3/projects/a536edaccd81491eaa7e81e42084089a/users/a3e92a11a89846938f834dcb98d17a17/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:33.693150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:33.711850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf0da-ff5f-45e0-b7ff-d5256a5a874a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:33.899658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:33.903648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:33.904135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:33.906505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:33.907382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:33.914316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:33.931221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cd67-0acd-4386-b613-be952cf43afa None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:33.932075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cd67-0acd-4386-b613-be952cf43afa None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:33.932538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cd67-0acd-4386-b613-be952cf43afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:33.980495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 880/1753] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:33.983852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:34.012236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ac2f-4561-4024-9fb5-c0afb6b1d760 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:34.031129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d8c4c-d36c-4a06-ad03-4942423e38ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:34.034945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d8c4c-d36c-4a06-ad03-4942423e38ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:34.035817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d8c4c-d36c-4a06-ad03-4942423e38ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:34.036604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d8c4c-d36c-4a06-ad03-4942423e38ad admin admin] PATH_INFO: `/v3/projects/a536edaccd81491eaa7e81e42084089a/users/a3e92a11a89846938f834dcb98d17a17/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:34.045188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d8c4c-d36c-4a06-ad03-4942423e38ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a536edaccd81491eaa7e81e42084089a, user_id=a3e92a11a89846938f834dcb98d17a17, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:34.067176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d8c4c-d36c-4a06-ad03-4942423e38ad admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:34.136776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 881/1754] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:33 2022] PUT /identity/v3/projects/a536edaccd81491eaa7e81e42084089a/users/a3e92a11a89846938f834dcb98d17a17/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:34.154218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:34.154506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:34.154805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:34.155849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-43d6cd67-0acd-4386-b613-be952cf43afa None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:34.163731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-43d6cd67-0acd-4386-b613-be952cf43afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:34.213148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] MFA Rules not processed for user `6f56d81c90714d7584d80cf3fb1d4075`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:34.222086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:34.324186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 874/1755] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:34.328808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:34.328808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:34.328808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:34.456059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] MFA Rules not processed for user `a3e92a11a89846938f834dcb98d17a17`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:34.466891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:34.495277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 882/1756] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:34.624139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:34.737991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:34.740245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:34.779765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 875/1757] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:34.944991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:34.947356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:34.995908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.206026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9bf8-7073-445e-b92b-0d9f1ba642f5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:35.232828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f359e4-2661-4c1e-82c4-9efbdfeb6c23 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:35.233028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b4f1b-3ca7-444d-9514-a92671e8ce8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:35.237574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:35.238215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:35.238494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:35.238762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4f1b-3ca7-444d-9514-a92671e8ce8b service swift] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:35.238880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.239301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4f1b-3ca7-444d-9514-a92671e8ce8b service swift] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:35.240520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4f1b-3ca7-444d-9514-a92671e8ce8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.250144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:35.254792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:35.276172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b4f1b-3ca7-444d-9514-a92671e8ce8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:35.279401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 876/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:35.283689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b4f1b-3ca7-444d-9514-a92671e8ce8b service swift] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:35.284727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:35.287581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:35.356704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 883/1759] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:48:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:48:35.436027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023bfe-457d-4a52-95bc-ab3744af002c service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:35.452630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:35.453837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:35.454367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:35.454948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] PATH_INFO: `/v3/users/d9663efb12c049da869ca0ce98427545` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.460594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9663efb12c049da869ca0ce98427545)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:35.468338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:35.566558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9663efb12c049da869ca0ce98427545'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:35.567439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9663efb12c049da869ca0ce98427545'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:35.585350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9663efb12c049da869ca0ce98427545'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:35.625020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9663efb12c049da869ca0ce98427545'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:35.627285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9663efb12c049da869ca0ce98427545'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:35.633698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.667371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 877/1760] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:35 2022] DELETE /identity/v3/users/d9663efb12c049da869ca0ce98427545 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:35.673493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:35.674105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:35.674638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.819561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:35.827466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:35.872586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:35.874153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:36.113889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 884/1761] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:36.191065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:36.192863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:36.227208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416177-02b4-4837-b481-c8ed24c43f13 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:36.261743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:36.265028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:36.268460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:36.268868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] PATH_INFO: `/v3/users/b7e36c577f004d12a0fc4b4c7726dcc4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:36.273649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e36c577f004d12a0fc4b4c7726dcc4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:36.284559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:36.504727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e36c577f004d12a0fc4b4c7726dcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:36.505713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e36c577f004d12a0fc4b4c7726dcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:36.529285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd679a-ad48-4396-93f3-feda341f9138 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:36.535880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e36c577f004d12a0fc4b4c7726dcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:36.542668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03007cb-8808-4fb4-be8d-fa3f194d2f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:36.543733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03007cb-8808-4fb4-be8d-fa3f194d2f87 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:36.544982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03007cb-8808-4fb4-be8d-fa3f194d2f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:36.548610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03007cb-8808-4fb4-be8d-fa3f194d2f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:36.588911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03007cb-8808-4fb4-be8d-fa3f194d2f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:36.592081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03007cb-8808-4fb4-be8d-fa3f194d2f87 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:36.597827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e36c577f004d12a0fc4b4c7726dcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:36.600532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e36c577f004d12a0fc4b4c7726dcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:36.620889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 885/1762] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:36.624693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6dcb-4fc2-4f37-9303-19b60915946d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:36.625280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6dcb-4fc2-4f37-9303-19b60915946d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:36.627034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6dcb-4fc2-4f37-9303-19b60915946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:36.642755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 878/1763] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:35 2022] DELETE /identity/v3/users/b7e36c577f004d12a0fc4b4c7726dcc4 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:36.644948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:36.649477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:36.709688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6d8a6dcb-4fc2-4f37-9303-19b60915946d None None] MFA Rules not processed for user `2c55486a82b54091ad04eaa32fdd3a36`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:36.712341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6d8a6dcb-4fc2-4f37-9303-19b60915946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:36.891304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17f154-9453-438f-936e-a85b45928799 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:36.905783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:36.919644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:36.919929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:36.926265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] PATH_INFO: `/v3/users/f0ef4bdda1d848a3a71cf498ee6021a9` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:36.929950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ef4bdda1d848a3a71cf498ee6021a9)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:36.934012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:36.950991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 886/1764] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:36.953787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4a67-6bbb-42f2-886c-525ceeac1cb0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:36.954365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4a67-6bbb-42f2-886c-525ceeac1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:36.955015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4a67-6bbb-42f2-886c-525ceeac1cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.004168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:37.097318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-521e4a67-6bbb-42f2-886c-525ceeac1cb0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:37.115845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-521e4a67-6bbb-42f2-886c-525ceeac1cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.145573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ef4bdda1d848a3a71cf498ee6021a9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:37.147336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ef4bdda1d848a3a71cf498ee6021a9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:37.164042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ef4bdda1d848a3a71cf498ee6021a9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:37.177150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 887/1765] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:37.188431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ef4bdda1d848a3a71cf498ee6021a9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:37.189335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5c53b166-ccca-48a4-968c-ca38fed1c379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ef4bdda1d848a3a71cf498ee6021a9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:37.219630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:37.220172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:37.220730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.233410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 879/1766] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:36 2022] DELETE /identity/v3/users/f0ef4bdda1d848a3a71cf498ee6021a9 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:37.239838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825519d-d962-4132-9917-79c81f19bfab None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:37.241153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825519d-d962-4132-9917-79c81f19bfab None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:37.241606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825519d-d962-4132-9917-79c81f19bfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.265683 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:37.320263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3825519d-d962-4132-9917-79c81f19bfab None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:37.321860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3825519d-d962-4132-9917-79c81f19bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.330812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] MFA Rules not processed for user `0b470479df27467c865a3b99b7554759`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:37.332072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.537252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 888/1767] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:37.540173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:37.542699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.549768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 880/1768] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:37.553070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825519d-d962-4132-9917-79c81f19bfab None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:37.557554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3825519d-d962-4132-9917-79c81f19bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.591105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825519d-d962-4132-9917-79c81f19bfab None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:37.612219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:37.613363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:37.613535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:37.613894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.619412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:37.626534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:37.743171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127f8fb-532e-4e39-b0f8-afdebc9f4b50 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:37.757060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 881/1769] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:37 2022] POST /identity/v3/projects => generated 405 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:37.758367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:37.928878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a2b4-fd8a-4fb2-96f2-54309d1d4ac0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:37.942607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:37.943670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:37.944093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:37.944699 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.946126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:37.950507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:37.951124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:37.951547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.959014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:38.012248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:38.113222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:38.115561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:38.141560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 882/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:38.143823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:38.165787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f082-d34f-4b24-a290-69e3f89f3361 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:38.180126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:38.181180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:38.183578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:38.184090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:38.185223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:38.190632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:38.233386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:38.234982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:38.237798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 883/1771] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:38 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:38.241838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:38.263908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0acf1-5ba3-4802-b3ee-335294311881 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:38.271019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 889/1772] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:38.278156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:38.279268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:38.279765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:38.280256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:38.281495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:38.286975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:38.309548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 884/1773] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:38.315143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:38.324756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:38.338341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c009f9-e999-454e-a959-7d032b85e24d service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:38.363541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:38.364246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:38.364524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:38.364794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] PATH_INFO: `/v3/projects/f385b2a2c28b4ad9a419c6f04f91aea0/users/a215a106adc943a0bcd74fdcfdff97ae/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:38.376679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:38.378921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:38.400927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e5941-d42d-4cf5-9f21-fb1304bbc4cb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:38.419938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:38.421015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:38.421508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:38.422030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] PATH_INFO: `/v3/users/93fe46df94a948419afd8102bb761b60` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:38.423749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f385b2a2c28b4ad9a419c6f04f91aea0, user_id=a215a106adc943a0bcd74fdcfdff97ae, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:38.426484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93fe46df94a948419afd8102bb761b60)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:38.431712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:38.433268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:38.477359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 890/1774] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:38 2022] PUT /identity/v3/projects/f385b2a2c28b4ad9a419c6f04f91aea0/users/a215a106adc943a0bcd74fdcfdff97ae/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:38.481440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:38.554951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93fe46df94a948419afd8102bb761b60'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:38.557147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93fe46df94a948419afd8102bb761b60'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:38.583067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93fe46df94a948419afd8102bb761b60'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:38.629766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93fe46df94a948419afd8102bb761b60'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:38.635189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9bac3f1b-79aa-4692-9a4c-ad7525d1e449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93fe46df94a948419afd8102bb761b60'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:38.664844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 885/1775] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:38 2022] DELETE /identity/v3/users/93fe46df94a948419afd8102bb761b60 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:38.669983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:38.670502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:38.670829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:38.701885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1343c9-eb89-4c3a-8116-065fb3cbea58 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:38.728014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:38.732930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:38.848955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 886/1776] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:39.014152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:39.015260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:39.015561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:39.015923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:39.016726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:39.018515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:39.053654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:39.055076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 891/1777] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:39.055276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:39.097358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391fdd3-4eba-4e7d-be94-c5a3f8c9880b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:39.123025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28eb48-b2b5-4448-bab7-b4f37cfb8d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:39.127153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28eb48-b2b5-4448-bab7-b4f37cfb8d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:39.127513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28eb48-b2b5-4448-bab7-b4f37cfb8d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:39.129008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28eb48-b2b5-4448-bab7-b4f37cfb8d62 admin admin] PATH_INFO: `/v3/projects/f385b2a2c28b4ad9a419c6f04f91aea0/users/a215a106adc943a0bcd74fdcfdff97ae/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:39.137602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28eb48-b2b5-4448-bab7-b4f37cfb8d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f385b2a2c28b4ad9a419c6f04f91aea0, user_id=a215a106adc943a0bcd74fdcfdff97ae, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:39.140535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28eb48-b2b5-4448-bab7-b4f37cfb8d62 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:39.155889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:39.186650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 887/1778] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:39 2022] PUT /identity/v3/projects/f385b2a2c28b4ad9a419c6f04f91aea0/users/a215a106adc943a0bcd74fdcfdff97ae/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:39.193913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:39.196409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:39.433626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af904e-d4b9-4e9f-bce7-0d14d9666436 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:39.530453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:39.566981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:39.568395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:39.569770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:39.570828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:39.732686 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:39.738041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:39.781575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 892/1779] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:40.392969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:40.394007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:40.394583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:40.440841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:40.448329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:40.485910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 888/1780] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Sep 6 11:48:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:40.507132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:40.509442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:40.547347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a1950-5191-4d41-bc15-e589bc0beceb service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:40.566293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:40.567013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:40.567313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:40.567585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] PATH_INFO: `/v3/projects/9dc3bed14de5461dbd0398705b588704` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:40.569222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc3bed14de5461dbd0398705b588704)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:40.571984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:40.700807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:40.702204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:40.735558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5947a-6e21-4013-aa6e-ea6b65b89bd3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:40.795510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc3bed14de5461dbd0398705b588704', 'request_id': 'req-2905d3ac-50bb-4283-8d0c-e08358e26d7b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:40.850855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc3bed14de5461dbd0398705b588704', 'request_id': 'req-2905d3ac-50bb-4283-8d0c-e08358e26d7b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:40.894739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc3bed14de5461dbd0398705b588704', 'request_id': 'req-2905d3ac-50bb-4283-8d0c-e08358e26d7b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:40.937054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] The token cache is being invalidate because project 9dc3bed14de5461dbd0398705b588704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:40.937790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:40.940200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:40.946142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 893/1781] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:40 2022] DELETE /identity/v3/projects/9dc3bed14de5461dbd0398705b588704 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:40.950917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:40.953528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:40.985813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:40.986464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:40.986782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:40.987055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:40.995987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:41.032691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:41.034457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:41.067867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 889/1782] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:41.100960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905d3ac-50bb-4283-8d0c-e08358e26d7b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:41.110461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:41.112073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:41.112573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:41.113044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] PATH_INFO: `/v3/users/3999d32f6b1846aa9e540474166b320b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:41.115932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3999d32f6b1846aa9e540474166b320b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:41.119240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:41.146476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:41.236856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3999d32f6b1846aa9e540474166b320b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:41.238354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3999d32f6b1846aa9e540474166b320b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:41.257174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3999d32f6b1846aa9e540474166b320b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:41.288168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3999d32f6b1846aa9e540474166b320b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:41.290062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3999d32f6b1846aa9e540474166b320b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:41.327860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 894/1783] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:40 2022] DELETE /identity/v3/users/3999d32f6b1846aa9e540474166b320b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:42.336469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:42.338555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:42.378083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f484-c29d-4d83-8a21-3ef0fbe60ffa service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:42.402371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:42.406053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:42.615023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94351b-e1eb-4b83-95ba-06d7b6629a5f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:42.633354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:42.634041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:42.634317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:42.635614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:42.636079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] PATH_INFO: `/v3/projects/3fddd18850ee49eeb7a0fe1af1a337db` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:42.636312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:42.636550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:42.636820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] PATH_INFO: `/v3/projects/f98d0d52188b49fe9ce71b3e8e972bc3` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:42.639297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98d0d52188b49fe9ce71b3e8e972bc3)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:42.643374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fddd18850ee49eeb7a0fe1af1a337db)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:42.647898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:42.648463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:42.790851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fddd18850ee49eeb7a0fe1af1a337db', 'request_id': 'req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.799719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fddd18850ee49eeb7a0fe1af1a337db', 'request_id': 'req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.806879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98d0d52188b49fe9ce71b3e8e972bc3', 'request_id': 'req-86b92c6c-bce2-43e0-97bd-577d6fe17a35'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.818238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98d0d52188b49fe9ce71b3e8e972bc3', 'request_id': 'req-86b92c6c-bce2-43e0-97bd-577d6fe17a35'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.823729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fddd18850ee49eeb7a0fe1af1a337db', 'request_id': 'req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.834568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98d0d52188b49fe9ce71b3e8e972bc3', 'request_id': 'req-86b92c6c-bce2-43e0-97bd-577d6fe17a35'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.860101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] The token cache is being invalidate because project f98d0d52188b49fe9ce71b3e8e972bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:42.865312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.866609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.870444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 895/1784] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:42 2022] DELETE /identity/v3/projects/f98d0d52188b49fe9ce71b3e8e972bc3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:42.871441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:42.875397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:42.881986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] The token cache is being invalidate because project 3fddd18850ee49eeb7a0fe1af1a337db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:42.882213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.885032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:42.890084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 890/1785] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:42 2022] DELETE /identity/v3/projects/3fddd18850ee49eeb7a0fe1af1a337db => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:42.893052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:42.903599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:42.947893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:43.007182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:43.054104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92c6c-bce2-43e0-97bd-577d6fe17a35 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:43.230075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:43.230777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.231107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.231382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] PATH_INFO: `/v3/projects/815b9b50ed4648ec8625eb06cf15b10a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:43.236472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=815b9b50ed4648ec8625eb06cf15b10a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:43.242153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:43.242824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c5cc-266b-4f41-8cfb-0dba0cd4f24c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:43.256973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:43.257976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.257976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.258227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] PATH_INFO: `/v3/users/fb5c65894d5948ba94f7005da167cd75` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:43.260410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5c65894d5948ba94f7005da167cd75)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:43.268869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:43.434283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815b9b50ed4648ec8625eb06cf15b10a', 'request_id': 'req-6b0a2630-5b06-400f-b0f9-656edae00c0b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.455662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815b9b50ed4648ec8625eb06cf15b10a', 'request_id': 'req-6b0a2630-5b06-400f-b0f9-656edae00c0b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.478270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815b9b50ed4648ec8625eb06cf15b10a', 'request_id': 'req-6b0a2630-5b06-400f-b0f9-656edae00c0b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.516740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] The token cache is being invalidate because project 815b9b50ed4648ec8625eb06cf15b10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:43.516971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.523233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.524891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5c65894d5948ba94f7005da167cd75'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.527767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5c65894d5948ba94f7005da167cd75'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.532822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 896/1786] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:42 2022] DELETE /identity/v3/projects/815b9b50ed4648ec8625eb06cf15b10a => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:43.532822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:43.535523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:43.555292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5c65894d5948ba94f7005da167cd75'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.595893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5c65894d5948ba94f7005da167cd75'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.596656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5c65894d5948ba94f7005da167cd75'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:43.629208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 891/1787] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:42 2022] DELETE /identity/v3/users/fb5c65894d5948ba94f7005da167cd75 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:43.629545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:43.632741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:43.780268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:43.785065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2630-5b06-400f-b0f9-656edae00c0b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:43.903820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d28d-5713-4f47-94c6-cedd9fa2401f admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:43.919129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:43.919473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.919764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.920042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] PATH_INFO: `/v3/users/a3e92a11a89846938f834dcb98d17a17` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:43.923646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e92a11a89846938f834dcb98d17a17)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:43.931173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:43.937843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:43.938883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.941610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.942081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] PATH_INFO: `/v3/projects/6222bee983004225ad357302ea1e75c4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:43.952563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6222bee983004225ad357302ea1e75c4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:43.963707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:44.031461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e92a11a89846938f834dcb98d17a17'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.032291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e92a11a89846938f834dcb98d17a17'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.055769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e92a11a89846938f834dcb98d17a17'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.084089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e92a11a89846938f834dcb98d17a17'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.085017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-732a6144-9e2b-43b1-b5e4-86e1bfa477c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e92a11a89846938f834dcb98d17a17'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.120957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 897/1788] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:43 2022] DELETE /identity/v3/users/a3e92a11a89846938f834dcb98d17a17 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:44.122540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab9b2-77e5-46c2-89b2-809140c3e8d6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.124303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab9b2-77e5-46c2-89b2-809140c3e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.124466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab9b2-77e5-46c2-89b2-809140c3e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.143234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:44.196652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f03ab9b2-77e5-46c2-89b2-809140c3e8d6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:44.198113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f03ab9b2-77e5-46c2-89b2-809140c3e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.209542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6222bee983004225ad357302ea1e75c4', 'request_id': 'req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.228610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6222bee983004225ad357302ea1e75c4', 'request_id': 'req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.248274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6222bee983004225ad357302ea1e75c4', 'request_id': 'req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.289265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] The token cache is being invalidate because project 6222bee983004225ad357302ea1e75c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:44.289561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.292527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fb9976ad-ffbb-49f0-96ac-1217b9847c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:44.296383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 892/1789] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:43 2022] DELETE /identity/v3/projects/6222bee983004225ad357302ea1e75c4 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:44.297853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.298130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.298398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.389411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] MFA Rules not processed for user `a215a106adc943a0bcd74fdcfdff97ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:44.390972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.435930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 898/1790] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:44.437279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2801-7e99-40d8-acdb-77b307eaaae3 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.437719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2801-7e99-40d8-acdb-77b307eaaae3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.438003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2801-7e99-40d8-acdb-77b307eaaae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.520375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-146e2801-7e99-40d8-acdb-77b307eaaae3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:44.523081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-146e2801-7e99-40d8-acdb-77b307eaaae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.546079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 899/1791] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:44.558599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e331-03ad-4adf-b0e0-3cc3ed848a31 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.558955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e331-03ad-4adf-b0e0-3cc3ed848a31 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.559190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e331-03ad-4adf-b0e0-3cc3ed848a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.606182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-06d1e331-03ad-4adf-b0e0-3cc3ed848a31 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:44.608325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-06d1e331-03ad-4adf-b0e0-3cc3ed848a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.623602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 900/1792] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:44.623602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.623602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.623602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.668793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:44.670427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.676325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 893/1793] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:44.677079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:44.690588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 901/1794] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:44.695491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:44.702018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:44.710196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387751d-2a31-453d-9fde-6d1e6becf22b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:44.717931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:44.718596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.719048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.719386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.720314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:44.721390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:44.723611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:44.728589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427da2b-e989-408a-baaf-0d3e3b0dc3b2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:44.743397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 902/1795] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:44.744344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:44.756732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:44.757161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.757439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.757730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.757949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d5386-723c-4e4e-8982-bd99258a22a5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:44.758630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:44.759049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:44.763522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:44.765255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:44.771002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.771328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.771619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.772746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:44.775163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:44.810215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 894/1796] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:44.812079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:44.822620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 903/1797] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:44.827243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:44.831952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8d39-3b8a-4098-ba41-d54d568c6692 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:44.983452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:44.984091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.984664 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.984935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.985590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:44.987755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.007813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7af9-7a26-4aac-b3bc-5dd632f7a914 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.015732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.017319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.017986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.018340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.019110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.021174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.056213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 895/1798] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:45.060833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.065138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 904/1799] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:44 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:45.066126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.087699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cc9b-ba3e-479b-933a-a502f0493e77 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.125012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:45.193288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594028c3-37e5-4491-bba2-a02ce0f02024 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.211674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.212343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.212643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.217414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.220735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.227592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.230096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.233337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.233600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.234150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.235436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.241090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.265201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 905/1800] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:45.269539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.278728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 896/1801] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:45 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:45.281778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.309164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fe15d-9732-40c9-9467-f1a9872e96c9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.318329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa475774-293f-4841-87f3-5911a014f059 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.322146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.322801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.323095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.323380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.325355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.328289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.332954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.333586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.333890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.334155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.334858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.342603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.357491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 906/1802] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:45.362801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.371824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 897/1803] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:45.375437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.392046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca358-0db4-4764-acaa-169ae17c5a0d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.397524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6227f-2ea6-4e38-9fd5-798bbb9732ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.397992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04e8b3-8515-4932-bee3-4f383c676ab9 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.398403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6227f-2ea6-4e38-9fd5-798bbb9732ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.398820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6227f-2ea6-4e38-9fd5-798bbb9732ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.399491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6227f-2ea6-4e38-9fd5-798bbb9732ab admin admin] PATH_INFO: `/v3/projects/078ba32475e34fb7b9c4623bb6af1ecd/users/ea118ecaded443c7ac0178db6beb16ac/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.419720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.420370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.420650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.420922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.421578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.422662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6227f-2ea6-4e38-9fd5-798bbb9732ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=078ba32475e34fb7b9c4623bb6af1ecd, user_id=ea118ecaded443c7ac0178db6beb16ac, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.425791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6227f-2ea6-4e38-9fd5-798bbb9732ab admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.431422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.450753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 907/1804] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:45 2022] PUT /identity/v3/projects/078ba32475e34fb7b9c4623bb6af1ecd/users/ea118ecaded443c7ac0178db6beb16ac/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:45.461627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.462246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.462646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.474491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 898/1805] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:48:45.479844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.502466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] MFA Rules not processed for user `ea118ecaded443c7ac0178db6beb16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:45.504041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:45.504746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f21d15-8b9a-46b9-8c02-7e266194279b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.523483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:45.647947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077019f-99ed-4147-a6af-3de9d0b43634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.648517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 908/1806] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:45.652303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077019f-99ed-4147-a6af-3de9d0b43634 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.652886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077019f-99ed-4147-a6af-3de9d0b43634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.653271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077019f-99ed-4147-a6af-3de9d0b43634 admin admin] PATH_INFO: `/v3/projects/37c2b6849a7040a7bc30e8d8d43c845f/users/4877417909cb467398573a2092b465da/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.662864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.681963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9401a1-bfad-41db-89d2-4f91b2e1550a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.686589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077019f-99ed-4147-a6af-3de9d0b43634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c2b6849a7040a7bc30e8d8d43c845f, user_id=4877417909cb467398573a2092b465da, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.692067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077019f-99ed-4147-a6af-3de9d0b43634 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.708013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.713767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.713767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.713767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.713767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.716698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.717385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 899/1807] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:45 2022] PUT /identity/v3/projects/37c2b6849a7040a7bc30e8d8d43c845f/users/4877417909cb467398573a2092b465da/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:45.728129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.728580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.728984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.783209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 909/1808] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:45 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:45.790551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.795682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] MFA Rules not processed for user `4877417909cb467398573a2092b465da`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:45.797307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:45.948797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2685e-55f3-4f4e-bd0c-1ef30c00496b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:45.961986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:45.962635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:45.962954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:45.963247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:45.963835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:45.965775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:45.970724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 900/1809] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:45.979686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:45.995622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498a7e-3a37-4630-8003-79ceeb3f1286 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.003310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.004828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.005627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.006110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.007091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.009685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.016538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:46.041649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 910/1810] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:45 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:46.046374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.055938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 901/1811] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:45 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:46.058056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.068136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4410-56f7-45fb-8ea2-1457c0155a84 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.147285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c231b-71a8-4050-9658-6bba10909fb0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.152837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.153595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.153993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.154368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.155168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.158055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.209657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 902/1812] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:46 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:46.214155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.230824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748adf7-abba-4d2f-b848-916e17ae66f2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.232807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.233622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.234056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.234547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.235379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.237182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.250397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.251237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.251686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.252245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.253207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.255273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.259476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 911/1813] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:46.261613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.270299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:46.280979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 903/1814] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:46.286287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.297747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:46.307153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994796-d472-4a5e-a441-300cf9016d3b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.312682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.313331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.313611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.313887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] PATH_INFO: `/v3/projects/a536edaccd81491eaa7e81e42084089a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.314850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3ff1-f8d8-472c-90be-8be0fe73ec2c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.315077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a536edaccd81491eaa7e81e42084089a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.317138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.321818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.322915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.323227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.323498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] PATH_INFO: `/v3/projects/d43e3648c6c64dbea7e10ca843b2fc7a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.331024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:46.331450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43e3648c6c64dbea7e10ca843b2fc7a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.339499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.412895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a536edaccd81491eaa7e81e42084089a', 'request_id': 'req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.433102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a536edaccd81491eaa7e81e42084089a', 'request_id': 'req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.449378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a536edaccd81491eaa7e81e42084089a', 'request_id': 'req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.452452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43e3648c6c64dbea7e10ca843b2fc7a', 'request_id': 'req-b8f933b8-56a2-4bf9-a618-8cc6201a294b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.463566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43e3648c6c64dbea7e10ca843b2fc7a', 'request_id': 'req-b8f933b8-56a2-4bf9-a618-8cc6201a294b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.474817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] The token cache is being invalidate because project a536edaccd81491eaa7e81e42084089a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:46.475496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.485398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.487257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43e3648c6c64dbea7e10ca843b2fc7a', 'request_id': 'req-b8f933b8-56a2-4bf9-a618-8cc6201a294b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.497476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 912/1815] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:46 2022] DELETE /identity/v3/projects/a536edaccd81491eaa7e81e42084089a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:46.500888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.514010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:46.528952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] The token cache is being invalidate because project d43e3648c6c64dbea7e10ca843b2fc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:46.530282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.533341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:46.536417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 904/1816] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:46 2022] DELETE /identity/v3/projects/d43e3648c6c64dbea7e10ca843b2fc7a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:46.537435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:46.541900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:46.617768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:46.661351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af5fa9-a5f3-4ace-9d7b-55dea80e121b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.666821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f933b8-56a2-4bf9-a618-8cc6201a294b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:46.674377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddf0b2-534b-459f-8a3a-a54a7d3c99e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.675220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf0b2-534b-459f-8a3a-a54a7d3c99e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.675865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf0b2-534b-459f-8a3a-a54a7d3c99e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.675865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf0b2-534b-459f-8a3a-a54a7d3c99e9 admin admin] PATH_INFO: `/v3/projects/4402f1b855d040c7b04010bed4a1fb77/users/aa8d728c229d4893ab9d1596b26b5360/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.690678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d823f-0067-40d3-800e-c20c06a66508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:46.692973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d823f-0067-40d3-800e-c20c06a66508 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.693464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d823f-0067-40d3-800e-c20c06a66508 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.695127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d823f-0067-40d3-800e-c20c06a66508 admin admin] PATH_INFO: `/v3/projects/c517ede232ca4ed99a379495ffa12efb/users/65979738008544cd976d345a54f60e80/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.733965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddf0b2-534b-459f-8a3a-a54a7d3c99e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4402f1b855d040c7b04010bed4a1fb77, user_id=aa8d728c229d4893ab9d1596b26b5360, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.738196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddf0b2-534b-459f-8a3a-a54a7d3c99e9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.757325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d823f-0067-40d3-800e-c20c06a66508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c517ede232ca4ed99a379495ffa12efb, user_id=65979738008544cd976d345a54f60e80, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:46.764174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d823f-0067-40d3-800e-c20c06a66508 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:46.800196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 913/1817] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:46 2022] PUT /identity/v3/projects/c517ede232ca4ed99a379495ffa12efb/users/65979738008544cd976d345a54f60e80/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:46.810305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.811628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.814099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.827304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 905/1818] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:46 2022] PUT /identity/v3/projects/4402f1b855d040c7b04010bed4a1fb77/users/aa8d728c229d4893ab9d1596b26b5360/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:46.830985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:46.837457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:46.837867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:46.902757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:46.905646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:46.927224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:46.928606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.096649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 914/1819] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:47.100257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.101842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.139296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 906/1820] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:47.139296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.139535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fa8c2-819b-49dd-954e-b2489b8cfc3c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.147479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0121f-3967-43ae-89a6-0e8f76a762c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.147983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c7ca-685a-470a-9d33-32b467dd309c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.149662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0121f-3967-43ae-89a6-0e8f76a762c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.150540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0121f-3967-43ae-89a6-0e8f76a762c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.151511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0121f-3967-43ae-89a6-0e8f76a762c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.153003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0121f-3967-43ae-89a6-0e8f76a762c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.161786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0121f-3967-43ae-89a6-0e8f76a762c4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.162832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7d0d-ee05-480b-9f81-57b20783279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.163579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7d0d-ee05-480b-9f81-57b20783279c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.164197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7d0d-ee05-480b-9f81-57b20783279c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.164883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7d0d-ee05-480b-9f81-57b20783279c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.166604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7d0d-ee05-480b-9f81-57b20783279c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.170718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7d0d-ee05-480b-9f81-57b20783279c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.198349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 915/1821] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:47.202548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.202963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.203926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.209558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 907/1822] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:47.211092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.211382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.211659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.255463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:47.256835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.274442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:47.277607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 908/1823] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:47.278540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.284236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.302768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5229ec3-cf58-4456-8ea7-b33fe1fbdf0a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.307966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 916/1824] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:47.309112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.315175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:47.322797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef888ee-a8a8-42e5-8ea3-5d693030fff8 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.324259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.324822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.325132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.325544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] PATH_INFO: `/v3/projects/c517ede232ca4ed99a379495ffa12efb/users/65979738008544cd976d345a54f60e80/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.330415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c517ede232ca4ed99a379495ffa12efb, user_id=65979738008544cd976d345a54f60e80, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.332604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.334215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.335153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.335366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.335900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] PATH_INFO: `/v3/projects/4402f1b855d040c7b04010bed4a1fb77/users/aa8d728c229d4893ab9d1596b26b5360/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.339632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4402f1b855d040c7b04010bed4a1fb77, user_id=aa8d728c229d4893ab9d1596b26b5360, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.343520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.353844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 909/1825] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:47 2022] PUT /identity/v3/projects/c517ede232ca4ed99a379495ffa12efb/users/65979738008544cd976d345a54f60e80/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:47.354978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.379527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 917/1826] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:47 2022] PUT /identity/v3/projects/4402f1b855d040c7b04010bed4a1fb77/users/aa8d728c229d4893ab9d1596b26b5360/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:47.380855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.436686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faae8af-2173-4bf2-be32-2804da0a0e54 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.538012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a7f7-f089-4e0a-91e5-62eacaf06622 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.538638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:47.566494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.567689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.568404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.568682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.569454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:47.569764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.569874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.570406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.570731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.571016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.571657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad91ec5-ffa6-45b4-9797-13905707965c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.571888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:47.572106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.573726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb833e-9cf6-4871-b896-95b7936620da admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.596099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 910/1827] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:47.597717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c2d8-35d5-4499-b8ca-471ef9d06b50 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.597870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c2d8-35d5-4499-b8ca-471ef9d06b50 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.598123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c2d8-35d5-4499-b8ca-471ef9d06b50 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.604700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 911/1828] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:48:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:47.606201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439741d4-b82a-4a3d-b3a4-d2addf255ddd None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.607024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439741d4-b82a-4a3d-b3a4-d2addf255ddd None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.607879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439741d4-b82a-4a3d-b3a4-d2addf255ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.627206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 918/1829] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:47.629862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.630273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.630479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.684444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-439741d4-b82a-4a3d-b3a4-d2addf255ddd None None] MFA Rules not processed for user `65979738008544cd976d345a54f60e80`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:47.685704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-439741d4-b82a-4a3d-b3a4-d2addf255ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.688116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] MFA Rules not processed for user `aa8d728c229d4893ab9d1596b26b5360`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:47.690038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.824054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 919/1830] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:47.825496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.842930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e1e17-c9a9-416d-950e-10c372ba4749 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:47.853594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:47.854510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.855176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.857029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.858623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:47.860707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:47.902460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 920/1831] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:47.903799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 912/1832] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:47.908220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:47.908375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:47.908800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:47.909262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:47.954734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:47.958892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:47.986992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:48.017933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c726a5e-4644-48d8-a0e0-7acc826b90c4 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.024764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.024978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.025402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.025679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.026331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.028340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.072528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 921/1833] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:48.073545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.075555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.107924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 913/1834] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:48:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:48.111314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.137276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ceed-c6e1-4f22-9f01-33d06207f264 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.168517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2f795-9be3-4f73-8f5b-0b9debd6359d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.176992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.177641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.177928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.178222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.210251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:48.218009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.218920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.219309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.219687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.221288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.223470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.257850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 914/1835] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:48 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:48.258823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.261513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.279141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083fea9-e376-4d07-91f0-e67a466f3742 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.283694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.284717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.285081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.285467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.288414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.289676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.292206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.329101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 922/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:48.330148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.347202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a06dac-6f7f-4da1-95f9-5a85d38c9618 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.354743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.355476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.355757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.356186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.356887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.360519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.395528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 923/1837] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:48 2022] POST /identity/v3/users => generated 283 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:48.396752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.400420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.402134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.412782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6630827-04b4-4b80-a90f-a8bbac5d6a8f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.419099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.423945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.424293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.424577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.425649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.427530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.437861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 915/1838] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:48.438839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.439983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 924/1839] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:48.441022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.460139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e54ff-678a-4b16-9111-65bc98bcae6c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.476874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c06b6-d014-40c9-b8c0-f6ed09b81202 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.477996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.479098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.479635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.480292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.482585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.485975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.487721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.488280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.489481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.491408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.494392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.508557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 916/1840] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:48.509600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.532212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5dd42-4e95-4546-b4ff-f28f2619a826 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.539518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.540378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.541324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.541601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.542406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.544358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.546216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:48.564195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 917/1841] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:48.564396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.564512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.564598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.573603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04116-9ced-4783-9db4-fda8668bcf23 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.575802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 925/1842] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:48.576638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.580457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.581426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.582598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.582990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.583763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.586177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.589215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9aa27-b7c9-4077-8f7c-bacd3196affa service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.594435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9c51f-6645-4403-8633-0a89e6a53abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.595235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c51f-6645-4403-8633-0a89e6a53abe admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.595677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c51f-6645-4403-8633-0a89e6a53abe admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.596013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c51f-6645-4403-8633-0a89e6a53abe admin admin] PATH_INFO: `/v3/projects/41fc6dce79644938aba1f24b58567f42/users/b91a3aa9ff754bceabf1e455ad27014b/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.607905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 918/1843] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:48.609179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.618759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9c51f-6645-4403-8633-0a89e6a53abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fc6dce79644938aba1f24b58567f42, user_id=b91a3aa9ff754bceabf1e455ad27014b, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.623796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f84c6-0229-4f1e-b68e-25547f666e8b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:48.624773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9c51f-6645-4403-8633-0a89e6a53abe admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.630252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf5609-0f98-4fc6-a247-8f21b93d5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:48.632226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5609-0f98-4fc6-a247-8f21b93d5e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.633018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5609-0f98-4fc6-a247-8f21b93d5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.633475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5609-0f98-4fc6-a247-8f21b93d5e8c admin admin] PATH_INFO: `/v3/projects/77366c50b74445ecb2fbb12166fd6520/users/4acf1360ac354f93b42d6463b85093b6/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.655168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 926/1844] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:48 2022] PUT /identity/v3/projects/41fc6dce79644938aba1f24b58567f42/users/b91a3aa9ff754bceabf1e455ad27014b/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:48.659426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf5609-0f98-4fc6-a247-8f21b93d5e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77366c50b74445ecb2fbb12166fd6520, user_id=4acf1360ac354f93b42d6463b85093b6, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:48.662781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf5609-0f98-4fc6-a247-8f21b93d5e8c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:48.667790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.668082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.668366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.703313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 919/1845] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:48 2022] PUT /identity/v3/projects/77366c50b74445ecb2fbb12166fd6520/users/4acf1360ac354f93b42d6463b85093b6/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:48.708576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90331c14-d8f2-43c1-ba96-1edd513c3694 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.709206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90331c14-d8f2-43c1-ba96-1edd513c3694 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.710315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90331c14-d8f2-43c1-ba96-1edd513c3694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.748669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] MFA Rules not processed for user `b91a3aa9ff754bceabf1e455ad27014b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:48.751547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.779014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-90331c14-d8f2-43c1-ba96-1edd513c3694 None None] MFA Rules not processed for user `4acf1360ac354f93b42d6463b85093b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:48.781800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-90331c14-d8f2-43c1-ba96-1edd513c3694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.933277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 920/1846] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:48.935575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16f61-d2f6-4569-b1b8-79cb34af487c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:48.935856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16f61-d2f6-4569-b1b8-79cb34af487c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:48.937090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16f61-d2f6-4569-b1b8-79cb34af487c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:48.938060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 921/1847] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:48.939115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16f61-d2f6-4569-b1b8-79cb34af487c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:48.940791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0ca16f61-d2f6-4569-b1b8-79cb34af487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:48.971652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:48.981569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 927/1848] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:48.981569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.098254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16f61-d2f6-4569-b1b8-79cb34af487c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.115435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b16ad-7c5d-4e39-b489-862ba6e0be9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.116235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78bcbb-f8ae-450e-bdad-8ae7177b138e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.117861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b16ad-7c5d-4e39-b489-862ba6e0be9a service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.118346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b16ad-7c5d-4e39-b489-862ba6e0be9a service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.118881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b16ad-7c5d-4e39-b489-862ba6e0be9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.123795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.125062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.125633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.125953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.126625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.128758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.144423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b16ad-7c5d-4e39-b489-862ba6e0be9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.149084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b16ad-7c5d-4e39-b489-862ba6e0be9a service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.186162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 922/1849] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:49.189320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 928/1850] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:48 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:49.189664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.191120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.191709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.192131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.216653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:49.218118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:49.300153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:49.342744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ea8ba-5c45-4075-97ac-affbbf4664aa admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.363802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f8c2-9908-40b1-9109-d241cf50a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.364589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f8c2-9908-40b1-9109-d241cf50a872 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.364974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f8c2-9908-40b1-9109-d241cf50a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.365862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f8c2-9908-40b1-9109-d241cf50a872 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.368454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f8c2-9908-40b1-9109-d241cf50a872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.369691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 923/1851] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:49.371046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.373950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f8c2-9908-40b1-9109-d241cf50a872 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.384854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131cc21-5de3-4ad1-8d28-b57c4c596a7d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.390728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.391411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.391692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.391967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.392606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.395089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.433389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 929/1852] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:49.434886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4180-8472-482e-a017-e1a387aa2a2e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.435277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4180-8472-482e-a017-e1a387aa2a2e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.435650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4180-8472-482e-a017-e1a387aa2a2e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.437248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 930/1853] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 6 11:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:49.440731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 924/1854] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/users => generated 290 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:49.440862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4180-8472-482e-a017-e1a387aa2a2e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.443609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.456538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dc8ee-1fb0-4a5c-aea9-20e75bfb0037 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.573400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cac11-6806-47e1-8a0e-a53db5e64c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.574083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cac11-6806-47e1-8a0e-a53db5e64c9b admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.574357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cac11-6806-47e1-8a0e-a53db5e64c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.574736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cac11-6806-47e1-8a0e-a53db5e64c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.575377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cac11-6806-47e1-8a0e-a53db5e64c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.577904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4180-8472-482e-a017-e1a387aa2a2e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.581412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cac11-6806-47e1-8a0e-a53db5e64c9b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.584602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9b65-15f7-4b25-93e2-52ff136d9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.585236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9b65-15f7-4b25-93e2-52ff136d9eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.585519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9b65-15f7-4b25-93e2-52ff136d9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.586318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9b65-15f7-4b25-93e2-52ff136d9eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.587083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9b65-15f7-4b25-93e2-52ff136d9eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.589941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9b65-15f7-4b25-93e2-52ff136d9eb4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.593313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 925/1855] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:49.595462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.595751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.596380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.637987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 931/1856] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:49.641351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5664d-017c-4502-8527-f86b4fac277e None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.643638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5664d-017c-4502-8527-f86b4fac277e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.644055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5664d-017c-4502-8527-f86b4fac277e None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.647222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:49.647681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 932/1857] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:48:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:49.648587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5664d-017c-4502-8527-f86b4fac277e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.649103 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:49.686198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5664d-017c-4502-8527-f86b4fac277e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.692650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:49.694397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9820ca0-16ed-480c-9aab-0590b8368c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.695205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9820ca0-16ed-480c-9aab-0590b8368c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.695610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9820ca0-16ed-480c-9aab-0590b8368c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.695896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9820ca0-16ed-480c-9aab-0590b8368c1a admin admin] PATH_INFO: `/v3/projects/e7ed711f0c194ce1b7e48b49a062fc23/users/6d79f7d79c8e4ad58ea30a6028c42323/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.747619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9820ca0-16ed-480c-9aab-0590b8368c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ed711f0c194ce1b7e48b49a062fc23, user_id=6d79f7d79c8e4ad58ea30a6028c42323, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.750530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9820ca0-16ed-480c-9aab-0590b8368c1a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.776857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 926/1858] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:49.777910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.794587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 933/1859] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:49 2022] PUT /identity/v3/projects/e7ed711f0c194ce1b7e48b49a062fc23/users/6d79f7d79c8e4ad58ea30a6028c42323/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:49.795976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea41f3-ec44-4749-9053-52fee917f094 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.799321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.799599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.799872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.833663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:49.835092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:49.916425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.917189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.925237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.926103 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.926294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.927999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.936436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 934/1860] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:49.937948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.941430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 927/1861] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:49.946173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.965111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b66d3-1a6b-41bf-9e71-b77480b02472 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.971290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.972151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.972477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.972752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.973838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.977070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.991676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:49.992853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 928/1862] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:49.994326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.996448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:50.014971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4b92b-64ed-4f3c-9f77-c11a1aa4f98e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.021047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.021668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.022070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.022297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.034187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.036873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.051265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29708feb-fcc2-458d-b487-37cfb033d83a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.052075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 929/1863] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:50.053047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.065338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.066149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.066585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.067471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.073830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e52bf-ad7e-494b-9ec8-1e288f393e3a service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.081402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.082142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.082980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.083394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] PATH_INFO: `/v3/projects/a269f796ff464a2ea9b57b7945edd493/users/0126d9ca42544b2cae0fba0b9370913b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.096566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.103845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a269f796ff464a2ea9b57b7945edd493, user_id=0126d9ca42544b2cae0fba0b9370913b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.106773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.111795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.129366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 930/1864] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:50 2022] PUT /identity/v3/projects/a269f796ff464a2ea9b57b7945edd493/users/0126d9ca42544b2cae0fba0b9370913b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:50.130634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.147067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 935/1865] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:50.148025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.175213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d287-f3ff-41e3-8d21-06f5b477d04c service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.303795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303429-7065-42ee-bec3-380ec4582c6e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.316132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c462d-5b7c-4e41-aec3-9b89554c0fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.316829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c462d-5b7c-4e41-aec3-9b89554c0fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.317108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c462d-5b7c-4e41-aec3-9b89554c0fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.317384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c462d-5b7c-4e41-aec3-9b89554c0fb7 admin admin] PATH_INFO: `/v3/projects/e7ed711f0c194ce1b7e48b49a062fc23/users/6d79f7d79c8e4ad58ea30a6028c42323/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.330799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c462d-5b7c-4e41-aec3-9b89554c0fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ed711f0c194ce1b7e48b49a062fc23, user_id=6d79f7d79c8e4ad58ea30a6028c42323, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.335866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c462d-5b7c-4e41-aec3-9b89554c0fb7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.350509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:50.366253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 931/1866] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:50 2022] PUT /identity/v3/projects/e7ed711f0c194ce1b7e48b49a062fc23/users/6d79f7d79c8e4ad58ea30a6028c42323/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:50.378649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.379342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.379715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.389614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.390343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.390752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.391162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.391861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.393483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.428133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 936/1867] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:50.433271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.438609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:50.469999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdfc2a-d709-42ec-be22-c1f5842b28bf admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.475096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] MFA Rules not processed for user `6d79f7d79c8e4ad58ea30a6028c42323`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:50.480202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:50.604797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.605362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.605649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.608093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] PATH_INFO: `/v3/users/0b470479df27467c865a3b99b7554759` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.609598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b470479df27467c865a3b99b7554759)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.614374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.647998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 932/1868] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:50.651587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.668034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0d923-fb3a-4e3a-9a7f-bc234b116997 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.678792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.678792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.678792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.679245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] PATH_INFO: `/v3/projects/a269f796ff464a2ea9b57b7945edd493/users/0126d9ca42544b2cae0fba0b9370913b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.681660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a269f796ff464a2ea9b57b7945edd493, user_id=0126d9ca42544b2cae0fba0b9370913b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:50.687730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:50.722451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 933/1869] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:50 2022] PUT /identity/v3/projects/a269f796ff464a2ea9b57b7945edd493/users/0126d9ca42544b2cae0fba0b9370913b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:50.724646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.755799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b470479df27467c865a3b99b7554759'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:50.756979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b470479df27467c865a3b99b7554759'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:50.765821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:50.774363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b470479df27467c865a3b99b7554759'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:50.790817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b470479df27467c865a3b99b7554759'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:50.792287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3cd64b6d-cc67-4e45-8775-39ccacd58e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b470479df27467c865a3b99b7554759'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:50.816705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 937/1870] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:50 2022] DELETE /identity/v3/users/0b470479df27467c865a3b99b7554759 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:50.818402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.818795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.819142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.826963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38031c8-dba7-4571-95bf-ae071774dc28 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:50.866783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] MFA Rules not processed for user `0126d9ca42544b2cae0fba0b9370913b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:50.869363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:50.894601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:50.895443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:50.895783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:50.896070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:50.899072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:50.953966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:50.976162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 938/1871] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:50.989012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:50.990708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.005256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335afe4-0b08-4396-96e0-7790367b6301 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:51.010282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:51.011774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:51.012131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:51.012496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:51.014508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.016808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:51.018592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:51.059515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 934/1872] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:51.086721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:51.088682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:51.110866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 939/1873] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:51.176400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:51.179105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.196950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181986-77bd-4daa-b2fe-1ffc09f8c6de service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:51.201789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:51.202928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:51.203342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:51.204368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:51.206451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.319655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:51.323360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:51.339689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 935/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:51.652732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:51.654526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.768841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:51.796271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbce8a-5101-46dc-bea9-e9cd3879124d service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:51.804327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:51.805161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:51.805793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:51.806336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] PATH_INFO: `/v3/projects/086a2ec783ff4c119cad7044c455c280` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:51.808472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086a2ec783ff4c119cad7044c455c280)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:51.810996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:51.844655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:51.856541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46262e9-5310-407f-abb7-8f43e9b9f988 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:51.861405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:51.862259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:51.862678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:51.863136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:51.865800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.895921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086a2ec783ff4c119cad7044c455c280', 'request_id': 'req-99a53ce8-774c-4405-b4e3-674980d7a939'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:51.904243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086a2ec783ff4c119cad7044c455c280', 'request_id': 'req-99a53ce8-774c-4405-b4e3-674980d7a939'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:51.920560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086a2ec783ff4c119cad7044c455c280', 'request_id': 'req-99a53ce8-774c-4405-b4e3-674980d7a939'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:51.945807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] The token cache is being invalidate because project 086a2ec783ff4c119cad7044c455c280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:51.946185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:51.946877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:51.949099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 940/1875] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:51 2022] DELETE /identity/v3/projects/086a2ec783ff4c119cad7044c455c280 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:51.953279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:51.954882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:51.977275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:51.978808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:51.997426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 936/1876] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:52.128166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a53ce8-774c-4405-b4e3-674980d7a939 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.142143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.143427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.143814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.144943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] PATH_INFO: `/v3/users/a215a106adc943a0bcd74fdcfdff97ae` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.146271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a215a106adc943a0bcd74fdcfdff97ae)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.148573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.262898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a215a106adc943a0bcd74fdcfdff97ae'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.263836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a215a106adc943a0bcd74fdcfdff97ae'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.273222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a215a106adc943a0bcd74fdcfdff97ae'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.313524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a215a106adc943a0bcd74fdcfdff97ae'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.314304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a215a106adc943a0bcd74fdcfdff97ae'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.335081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 941/1877] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:51 2022] DELETE /identity/v3/users/a215a106adc943a0bcd74fdcfdff97ae => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:52.590007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.602441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc7d8-1fcb-45dc-99be-898d0da25fcd service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.671329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.672824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.678228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:52.678875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.680190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.680533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.680796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] PATH_INFO: `/v3/projects/f385b2a2c28b4ad9a419c6f04f91aea0` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.682092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f385b2a2c28b4ad9a419c6f04f91aea0)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.684128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.692924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:52.734583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e595ff-758b-487d-ae68-cdf7293fbc05 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.743798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f385b2a2c28b4ad9a419c6f04f91aea0', 'request_id': 'req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.749700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f385b2a2c28b4ad9a419c6f04f91aea0', 'request_id': 'req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.758215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f385b2a2c28b4ad9a419c6f04f91aea0', 'request_id': 'req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.769834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] The token cache is being invalidate because project f385b2a2c28b4ad9a419c6f04f91aea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:52.770262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.771014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2bbd96e8-1e8a-415a-a321-c58bdbed7fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:52.772612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 937/1878] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:52 2022] DELETE /identity/v3/projects/f385b2a2c28b4ad9a419c6f04f91aea0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:52.777463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac942-6385-456b-bb63-16c5287a7f1c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.777653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac942-6385-456b-bb63-16c5287a7f1c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.777918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac942-6385-456b-bb63-16c5287a7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.784277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.784900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.785180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.785454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.787225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.797538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d18ac942-6385-456b-bb63-16c5287a7f1c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:52.798727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d18ac942-6385-456b-bb63-16c5287a7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.850716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.852261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.858190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 938/1879] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:52.862539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 942/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:52.866153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.866442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.866749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.888635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:52.889963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.898874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 939/1881] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:52.903585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.914158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a499733-a35b-4f45-a9e6-36866ea5222c service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.919503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.920146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.920558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.920685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.921330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:52.921639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.923340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.934944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 943/1882] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:48:52.939421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.948996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1b517-f5fe-420d-afe2-cc9c41ac45ae None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.953769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.954378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.954654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.954972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.955645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.957946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.989951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 940/1883] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:52 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:52.990889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.002384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea59dd4-0d8d-425e-8aff-6f99b07802b5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.059710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:53.068620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.069247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.069564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.069841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.070473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.072645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.100906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 944/1884] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:52 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:53.102145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.113174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4bcb-4b44-4ccd-8667-b383029f0b71 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.118300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.118962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.119240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.119500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.120138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.121746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.131749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 941/1885] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:48:53.135879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.146480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fccfd-5eaf-4005-9e40-7a5fcd4369a8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.151487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d17d0-4db3-4b7f-af02-c0a58b420ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.152100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d17d0-4db3-4b7f-af02-c0a58b420ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.152364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d17d0-4db3-4b7f-af02-c0a58b420ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.152653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d17d0-4db3-4b7f-af02-c0a58b420ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.153307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d17d0-4db3-4b7f-af02-c0a58b420ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.154959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d17d0-4db3-4b7f-af02-c0a58b420ef5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.167317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 945/1886] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:53.172290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.182537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabcac6-19f5-4fd0-b44c-9b61a341098a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.188281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.189083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.189360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.189677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] PATH_INFO: `/v3/projects/7629c35635f943c9801bb5162f8e1dba/users/77f69d76f3da4dd5bf5b91214379ef9f/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.209337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7629c35635f943c9801bb5162f8e1dba, user_id=77f69d76f3da4dd5bf5b91214379ef9f, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.211943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.225892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 942/1887] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:53 2022] PUT /identity/v3/projects/7629c35635f943c9801bb5162f8e1dba/users/77f69d76f3da4dd5bf5b91214379ef9f/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:53.238412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.238887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.239191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.283738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] MFA Rules not processed for user `77f69d76f3da4dd5bf5b91214379ef9f`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:53.285020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:53.386924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 946/1888] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:53.391772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.451426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:53.515209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce49c-391b-47e5-a2a9-8a3d6ba5e01b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.526256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.527417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.529431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.529853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.530668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.536902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.598932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 943/1889] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:53 2022] POST /identity/v3/projects => generated 399 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:53.602724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.619024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33f2e-3db3-4407-82d7-53f947a175c8 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.734234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.735058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.735402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.735736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.736564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.738898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.773761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 947/1890] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:53 2022] POST /identity/v3/users => generated 306 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:53.777515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.791344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa931fb-df09-42d8-9be3-70c0a9c0806c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.812392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.813028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.813302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.813593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.814216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.820958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.838285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 944/1891] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:53.839408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.852287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861fb32-a8d8-43e3-b0d8-f579b7d4b721 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.860515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.861908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.862519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.863056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] PATH_INFO: `/v3/projects/624fccb1b18646b2b2970f1bfda628bc/users/ec0d205554ab4d2984773571908a6e68/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.883337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=624fccb1b18646b2b2970f1bfda628bc, user_id=ec0d205554ab4d2984773571908a6e68, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.886007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.902738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 948/1892] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:53 2022] PUT /identity/v3/projects/624fccb1b18646b2b2970f1bfda628bc/users/ec0d205554ab4d2984773571908a6e68/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:53.906111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:53.916476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bc5f6-1ffa-439b-bc1f-7728b5a5a1c2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:53.975573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b44e0-a6d6-4014-a676-60047d12044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:53.976190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b44e0-a6d6-4014-a676-60047d12044a admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:53.976462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b44e0-a6d6-4014-a676-60047d12044a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:53.976727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b44e0-a6d6-4014-a676-60047d12044a admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:53.977362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b44e0-a6d6-4014-a676-60047d12044a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:53.979012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b44e0-a6d6-4014-a676-60047d12044a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.995628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 945/1893] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:48:53.996619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:54.007192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28bfcb-e766-449a-a216-c00479617a7b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:54.011964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:54.012619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:54.012890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:54.013155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] PATH_INFO: `/v3/projects/624fccb1b18646b2b2970f1bfda628bc/users/ec0d205554ab4d2984773571908a6e68/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:54.015091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=624fccb1b18646b2b2970f1bfda628bc, user_id=ec0d205554ab4d2984773571908a6e68, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:54.017819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:54.027914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 949/1894] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:53 2022] PUT /identity/v3/projects/624fccb1b18646b2b2970f1bfda628bc/users/ec0d205554ab4d2984773571908a6e68/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:54.038031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:54.038316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:54.038586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:54.068845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] MFA Rules not processed for user `ec0d205554ab4d2984773571908a6e68`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:54.070075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:54.158275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 946/1895] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:54.171150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:54.173568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:54.205025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:54.246319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff422a-1f04-45f6-9d76-81ebcad6261e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:54.250092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:54.250883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:54.251218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:54.251489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:54.260650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:54.262137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:54.273903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 950/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:54.353081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:54.362974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc8d5-ee50-490c-9935-04f15e7b950e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:54.367308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b446753-3b76-4f10-a734-e409f56ef792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:54.368017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b446753-3b76-4f10-a734-e409f56ef792 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:54.368299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b446753-3b76-4f10-a734-e409f56ef792 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:54.368573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b446753-3b76-4f10-a734-e409f56ef792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:54.398106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:54.435307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b446753-3b76-4f10-a734-e409f56ef792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:54.436778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b446753-3b76-4f10-a734-e409f56ef792 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:54.446557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 947/1897] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:54 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:56.566370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:56.567997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:56.635813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14233c0-b2d0-4a5d-ad5a-4071deb325b5 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:56.642236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:56.642994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:56.643319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:56.643650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] PATH_INFO: `/v3/users/4877417909cb467398573a2092b465da` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:56.645333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4877417909cb467398573a2092b465da)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:56.648444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:56.707871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4877417909cb467398573a2092b465da'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.708951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4877417909cb467398573a2092b465da'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.720956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4877417909cb467398573a2092b465da'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.734358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4877417909cb467398573a2092b465da'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.735154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4877417909cb467398573a2092b465da'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.754509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 951/1898] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:56 2022] DELETE /identity/v3/users/4877417909cb467398573a2092b465da => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:56.759294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:56.759844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:56.759844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:56.780070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:56.781327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:56.852647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:56.854187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:56.859635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 948/1899] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:56.868191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028614bf-a41c-4524-927f-55ae41eb6752 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:56.871275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:56.872767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:56.873563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:56.874210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:56.874484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:56.874783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] PATH_INFO: `/v3/users/b91a3aa9ff754bceabf1e455ad27014b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:56.875919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91a3aa9ff754bceabf1e455ad27014b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:56.877832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:56.931521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:56.950724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91a3aa9ff754bceabf1e455ad27014b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.951659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91a3aa9ff754bceabf1e455ad27014b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.961784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91a3aa9ff754bceabf1e455ad27014b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.971022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d53735-f761-40ce-8612-bb5283bf6279 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:56.980553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:56.981275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:56.981547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:56.981848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:56.985024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91a3aa9ff754bceabf1e455ad27014b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:56.986050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6f13e5e3-e002-41a3-9ea2-da3a4a410774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91a3aa9ff754bceabf1e455ad27014b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.010938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 952/1900] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:56 2022] DELETE /identity/v3/users/b91a3aa9ff754bceabf1e455ad27014b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:57.011748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:57.012723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:57.013011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:57.013207 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:57.013330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:57.031993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 949/1901] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:57.045203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:57.047472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:57.129026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 953/1902] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:57.139585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:57.141835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:57.154838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1510a6-ca78-4eef-9959-cecb4e506370 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:57.170724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:57.172228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:57.184780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065c2e5-d809-4f67-9835-559a0fb2271f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:57.190021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:57.192481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:57.192794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:57.193073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] PATH_INFO: `/v3/users/4acf1360ac354f93b42d6463b85093b6` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:57.194603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4acf1360ac354f93b42d6463b85093b6)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:57.196468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:57.244036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf997c-4304-432e-9172-a7019a38b1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:57.245220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf997c-4304-432e-9172-a7019a38b1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:57.245499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf997c-4304-432e-9172-a7019a38b1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:57.245803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf997c-4304-432e-9172-a7019a38b1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:57.298719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf997c-4304-432e-9172-a7019a38b1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:57.301362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf997c-4304-432e-9172-a7019a38b1d7 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:57.332569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 950/1903] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:57.412453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4acf1360ac354f93b42d6463b85093b6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.413152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4acf1360ac354f93b42d6463b85093b6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.423965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4acf1360ac354f93b42d6463b85093b6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.449149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4acf1360ac354f93b42d6463b85093b6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.450572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4acf1360ac354f93b42d6463b85093b6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.477964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 954/1904] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:57 2022] DELETE /identity/v3/users/4acf1360ac354f93b42d6463b85093b6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:57.482819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:57.483326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:57.483739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:57.514104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:57.515557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:57.526839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:57.607152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 951/1905] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:57.624311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:57.625836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:57.668454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:57.718360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7fcec-149c-4a53-a365-e0dff800b39d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:57.725142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:57.726014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:57.726225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:57.726505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:57.733474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:57.735238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:57.743355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:57.745062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:57.754373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c9829-1dfc-476f-9dcb-b897e62ccfd0 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:57.757750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 955/1906] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:57.784402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:57.786020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:57.786602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:57.787802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] PATH_INFO: `/v3/projects/37c2b6849a7040a7bc30e8d8d43c845f` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:57.791881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c2b6849a7040a7bc30e8d8d43c845f)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:57.794645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:57.917793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c2b6849a7040a7bc30e8d8d43c845f', 'request_id': 'req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.928762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c2b6849a7040a7bc30e8d8d43c845f', 'request_id': 'req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.940810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c2b6849a7040a7bc30e8d8d43c845f', 'request_id': 'req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.957489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] The token cache is being invalidate because project 37c2b6849a7040a7bc30e8d8d43c845f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:57.958427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.959702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:57.963250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 952/1907] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:57 2022] DELETE /identity/v3/projects/37c2b6849a7040a7bc30e8d8d43c845f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:57.967664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:57.983516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b74ab-ed28-4b4c-84c0-19c2a5cc69a6 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:58.089362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:58.090325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.090788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.091222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] PATH_INFO: `/v3/users/aa8d728c229d4893ab9d1596b26b5360` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.093048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8d728c229d4893ab9d1596b26b5360)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:58.096043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:58.191979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8d728c229d4893ab9d1596b26b5360'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.192857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8d728c229d4893ab9d1596b26b5360'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.216336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8d728c229d4893ab9d1596b26b5360'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.234026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8d728c229d4893ab9d1596b26b5360'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.240541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:58.243402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:58.245617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8d728c229d4893ab9d1596b26b5360'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.271628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 956/1908] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:57 2022] DELETE /identity/v3/users/aa8d728c229d4893ab9d1596b26b5360 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:58.272822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:58.274014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafbb7-b7d9-4fb9-99e0-de9b87f2dcd2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:58.282911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:58.379873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:58.380282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.380721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.380996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] PATH_INFO: `/v3/projects/77366c50b74445ecb2fbb12166fd6520` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.383120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77366c50b74445ecb2fbb12166fd6520)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:58.385238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:58.407362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:58.439789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32e27-39f9-4379-a134-3bdc87fb4324 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:58.445745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:58.446837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.447112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.447382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] PATH_INFO: `/v3/projects/41fc6dce79644938aba1f24b58567f42` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.448584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fc6dce79644938aba1f24b58567f42)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:58.451687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:58.462021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:58.484538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77366c50b74445ecb2fbb12166fd6520', 'request_id': 'req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.494521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77366c50b74445ecb2fbb12166fd6520', 'request_id': 'req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.510914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77366c50b74445ecb2fbb12166fd6520', 'request_id': 'req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.520335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fc6dce79644938aba1f24b58567f42', 'request_id': 'req-41455c0a-088d-4f39-adf9-66c77959e202'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.524269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] The token cache is being invalidate because project 77366c50b74445ecb2fbb12166fd6520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:58.524561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.525206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b38be585-3f0b-4c2a-a482-98c6e5fbd0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.526730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 953/1909] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:58 2022] DELETE /identity/v3/projects/77366c50b74445ecb2fbb12166fd6520 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:58.527997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc82ea-4c0c-4042-a8b0-c096a006d41b None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.528269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc82ea-4c0c-4042-a8b0-c096a006d41b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.528609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc82ea-4c0c-4042-a8b0-c096a006d41b None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.529750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 954/1910] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:48:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:58.531206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc82ea-4c0c-4042-a8b0-c096a006d41b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:58.533233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-67fc82ea-4c0c-4042-a8b0-c096a006d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:58.544563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fc6dce79644938aba1f24b58567f42', 'request_id': 'req-41455c0a-088d-4f39-adf9-66c77959e202'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.554941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fc6dce79644938aba1f24b58567f42', 'request_id': 'req-41455c0a-088d-4f39-adf9-66c77959e202'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.569782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] The token cache is being invalidate because project 41fc6dce79644938aba1f24b58567f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:58.570077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.570993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-41455c0a-088d-4f39-adf9-66c77959e202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.572764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 957/1911] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:58 2022] DELETE /identity/v3/projects/41fc6dce79644938aba1f24b58567f42 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:58.574174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.574463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.574772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.596883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:58.598036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:58.612118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc82ea-4c0c-4042-a8b0-c096a006d41b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:58.618441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:58.619129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.619407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.619676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] PATH_INFO: `/v3/users/6d79f7d79c8e4ad58ea30a6028c42323` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.620820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d79f7d79c8e4ad58ea30a6028c42323)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:58.622951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:58.683426 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 958/1912] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:48:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:58.684317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:58.686202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:58.729578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ed4b2-d0d8-469d-be9b-52fe819523ea None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:58.742724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d79f7d79c8e4ad58ea30a6028c42323'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.743936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d79f7d79c8e4ad58ea30a6028c42323'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.748945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:58.749637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:58.749929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:58.753448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] PATH_INFO: `/v3/users/0126d9ca42544b2cae0fba0b9370913b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:58.756358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0126d9ca42544b2cae0fba0b9370913b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:58.760641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:58.766357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d79f7d79c8e4ad58ea30a6028c42323'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.794648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d79f7d79c8e4ad58ea30a6028c42323'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.798609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d79f7d79c8e4ad58ea30a6028c42323'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.830615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 955/1913] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:58 2022] DELETE /identity/v3/users/6d79f7d79c8e4ad58ea30a6028c42323 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:58.832537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:58.834007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:58.910390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0126d9ca42544b2cae0fba0b9370913b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.916033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0126d9ca42544b2cae0fba0b9370913b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.938590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:58.940054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0126d9ca42544b2cae0fba0b9370913b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.967629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:58.993866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0126d9ca42544b2cae0fba0b9370913b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.997490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0126d9ca42544b2cae0fba0b9370913b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:58.998089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688a605-dd57-459f-8513-3ddf9d56ed95 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.012768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.013879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.014361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.014894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.017372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.035278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.037452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.041956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 959/1914] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:58 2022] DELETE /identity/v3/users/0126d9ca42544b2cae0fba0b9370913b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:59.044366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.047402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.064642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 956/1915] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:59.066047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.070269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.137974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a736-71d7-4a4a-9efa-71d00b6debd4 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.146175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.147861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.148045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.148481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] PATH_INFO: `/v3/projects/4402f1b855d040c7b04010bed4a1fb77` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.149794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4402f1b855d040c7b04010bed4a1fb77)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.152167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.234538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4402f1b855d040c7b04010bed4a1fb77', 'request_id': 'req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.244443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4402f1b855d040c7b04010bed4a1fb77', 'request_id': 'req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.259209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4402f1b855d040c7b04010bed4a1fb77', 'request_id': 'req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.289227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] The token cache is being invalidate because project 4402f1b855d040c7b04010bed4a1fb77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:59.290450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.291411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a2e3697c-a45a-4ea5-bf5c-073a4afb7e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.293477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 960/1916] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:59 2022] DELETE /identity/v3/projects/4402f1b855d040c7b04010bed4a1fb77 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:59.298676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68756-a36c-4326-ab9c-b2887d86dbf0 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.299490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145cc0-7271-4be2-99ca-5303776a7b5d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.299775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145cc0-7271-4be2-99ca-5303776a7b5d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.300044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145cc0-7271-4be2-99ca-5303776a7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.341901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-13145cc0-7271-4be2-99ca-5303776a7b5d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:59.343803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-13145cc0-7271-4be2-99ca-5303776a7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.423423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.424109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.424388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.424662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] PATH_INFO: `/v3/users/77f69d76f3da4dd5bf5b91214379ef9f` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.426595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f69d76f3da4dd5bf5b91214379ef9f)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.430571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.488550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 961/1917] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:59.496428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.496779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.497102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.515050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f69d76f3da4dd5bf5b91214379ef9f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.516402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f69d76f3da4dd5bf5b91214379ef9f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.524052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:59.524589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f69d76f3da4dd5bf5b91214379ef9f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.525365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.540951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 962/1918] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:59.542834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.546949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f69d76f3da4dd5bf5b91214379ef9f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.548477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5eda37fc-6d08-4cf1-ad2e-8c35055183d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f69d76f3da4dd5bf5b91214379ef9f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:59.549744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:59.559405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:59.560545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d396f7d-8a5d-4a3e-b666-10f23225a7fd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.570816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 957/1919] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:59 2022] DELETE /identity/v3/users/77f69d76f3da4dd5bf5b91214379ef9f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:59.574430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.576463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.576753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.577065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.577774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:59.578027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.580288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.586377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630171-6522-4b9e-a338-34077ed31190 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.586669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630171-6522-4b9e-a338-34077ed31190 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.586972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630171-6522-4b9e-a338-34077ed31190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.609342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 963/1920] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:59.611419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.614497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.619985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-56630171-6522-4b9e-a338-34077ed31190 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:59.621311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-56630171-6522-4b9e-a338-34077ed31190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:59.638829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182e3d-8ce0-43a5-9310-54520e04b5cd admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.723777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.725215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.725864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.726342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.727365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.729687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.750976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 958/1921] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:59.783466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 964/1922] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:59 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:59.787829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630171-6522-4b9e-a338-34077ed31190 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.798993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630171-6522-4b9e-a338-34077ed31190 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.866448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.867123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.867450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.867775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.868429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.870429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.912318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 959/1923] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:59 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:59.915592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.933555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e98a-5ed2-46d9-b491-e16a28eb189b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:59.962781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:59.964013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:59.964550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:59.965026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:59.966135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:59.968168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:59.987087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 965/1924] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:59.987279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:59.999422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541171-091c-4255-a2c9-c9347e869a83 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.005506 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.006292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.006718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.007120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.008040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.009833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.026382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 960/1925] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:00.027866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.041308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0657947-018f-418b-b962-4def90be40dc admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.053942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafc40-3880-477b-96f3-f082c9686875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.054653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafc40-3880-477b-96f3-f082c9686875 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.054959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafc40-3880-477b-96f3-f082c9686875 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.055498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafc40-3880-477b-96f3-f082c9686875 admin admin] PATH_INFO: `/v3/projects/bac9360c68f14390b5f5e91fc3731a8e/users/44a699fba10a44a38e6c7a4586bf32dc/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.092646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafc40-3880-477b-96f3-f082c9686875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac9360c68f14390b5f5e91fc3731a8e, user_id=44a699fba10a44a38e6c7a4586bf32dc, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.096594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafc40-3880-477b-96f3-f082c9686875 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.121377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 966/1926] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:00 2022] PUT /identity/v3/projects/bac9360c68f14390b5f5e91fc3731a8e/users/44a699fba10a44a38e6c7a4586bf32dc/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:00.132820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.134307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.134674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.134994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.135184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.201702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] MFA Rules not processed for user `44a699fba10a44a38e6c7a4586bf32dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:00.208165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.263419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7e787-8016-478b-aff9-45418a1ca82b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.321994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 967/1927] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:00.322930 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.325231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.404826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:00.432730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:00.468062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df030d9-ea43-4640-afa8-d7d3677fdb9b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.477105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.478020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.478508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.478995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] PATH_INFO: `/v3/projects/a269f796ff464a2ea9b57b7945edd493` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.482070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a269f796ff464a2ea9b57b7945edd493)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.486603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.491521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.492578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.493112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.493680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.505078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.507584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.521594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 961/1928] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:00.522793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.534466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b58f9-5b32-4a2b-97e6-6477080a4c5a service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.542655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.543762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.544706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.545443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.546527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.549162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.576988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a269f796ff464a2ea9b57b7945edd493', 'request_id': 'req-381b488d-8905-478d-9b5c-30c2662339b8'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:00.585120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a269f796ff464a2ea9b57b7945edd493', 'request_id': 'req-381b488d-8905-478d-9b5c-30c2662339b8'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:00.593408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a269f796ff464a2ea9b57b7945edd493', 'request_id': 'req-381b488d-8905-478d-9b5c-30c2662339b8'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:00.612886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] The token cache is being invalidate because project a269f796ff464a2ea9b57b7945edd493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:00.613335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:00.614071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-381b488d-8905-478d-9b5c-30c2662339b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:00.616012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 968/1929] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:00 2022] DELETE /identity/v3/projects/a269f796ff464a2ea9b57b7945edd493 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:00.622852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66324e-e402-412c-827d-638de45adf95 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.623920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66324e-e402-412c-827d-638de45adf95 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.624206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66324e-e402-412c-827d-638de45adf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.645991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 962/1930] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:00 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:00.645991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.647746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.648540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0d66324e-e402-412c-827d-638de45adf95 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:00.650259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0d66324e-e402-412c-827d-638de45adf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.759026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 969/1931] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:00.763188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.763456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.763826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.799848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:00.801375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.820773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 970/1932] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:00.825605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c1082-9c06-4f93-8a1a-3bc7778d5c4f admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.826050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.843128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.844059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.844448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.844714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.845357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.846843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f772e-092f-4639-8f55-301e10cbe4d2 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.847345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.863588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.863588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.863588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.863588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.864277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:00.864277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.864277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.888183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 971/1933] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:00.889639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.897168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 963/1934] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:00 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:49:00.898405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.914433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da12ec-bbb4-41c3-8fd3-a9f342446213 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.918455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.919012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.919282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.919557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.920208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.922805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.929458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7c1c-33c6-458a-a611-bf7ea1837e52 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.936149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.936879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.937122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.937357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.938510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.940419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:00.954760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 964/1935] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:00.955922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:00.958877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:00.974665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c7ef-e4d5-4c7e-97c6-9e45b844106e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:00.980535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:00.981322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:00.981598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:00.981885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] PATH_INFO: `/v3/projects/e7ed711f0c194ce1b7e48b49a062fc23` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:00.983619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ed711f0c194ce1b7e48b49a062fc23)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:00.987371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.012166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 972/1936] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:01.012166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.038301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:01.059397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ed711f0c194ce1b7e48b49a062fc23', 'request_id': 'req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.080340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ed711f0c194ce1b7e48b49a062fc23', 'request_id': 'req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.091455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ed711f0c194ce1b7e48b49a062fc23', 'request_id': 'req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.110025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] The token cache is being invalidate because project e7ed711f0c194ce1b7e48b49a062fc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:01.110396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.111187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.113247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 965/1937] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:00 2022] DELETE /identity/v3/projects/e7ed711f0c194ce1b7e48b49a062fc23 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:01.113966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.119165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.131721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867283a-1f90-4740-8ffa-ead6a3148ab5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.152330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:01.215709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998741a-1c37-46bd-aa81-f9f778e6b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.217692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998741a-1c37-46bd-aa81-f9f778e6b401 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.218149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998741a-1c37-46bd-aa81-f9f778e6b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.218570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998741a-1c37-46bd-aa81-f9f778e6b401 admin admin] PATH_INFO: `/v3/projects/9f035fd00424417999d1c6e3535c260a/users/4c16cb1dbde14d15836c1be2ad2292e2/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.238522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998741a-1c37-46bd-aa81-f9f778e6b401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f035fd00424417999d1c6e3535c260a, user_id=4c16cb1dbde14d15836c1be2ad2292e2, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.241780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998741a-1c37-46bd-aa81-f9f778e6b401 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.266153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 973/1938] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:01 2022] PUT /identity/v3/projects/9f035fd00424417999d1c6e3535c260a/users/4c16cb1dbde14d15836c1be2ad2292e2/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:01.268565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.269086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.269507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.288171 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbda2-f9f9-42cd-a240-8eb95fc2b073 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.312648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:01.314208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.413224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 974/1939] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:01.413224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.415353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.431665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70168ac-3143-4bba-ba43-b20dad237484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.432339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70168ac-3143-4bba-ba43-b20dad237484 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.432643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70168ac-3143-4bba-ba43-b20dad237484 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.432917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70168ac-3143-4bba-ba43-b20dad237484 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.433745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70168ac-3143-4bba-ba43-b20dad237484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.435890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70168ac-3143-4bba-ba43-b20dad237484 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.459117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e956f-7319-4009-84fb-41accd91ad9a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.468729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.469478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.469829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.470173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.470935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.475368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 966/1940] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:01 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:01.475511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.475989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.476282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.476562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.499455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 975/1941] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:01.499455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.503520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.505865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:01.507109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.518515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c226af-edb8-40dc-8d54-045ad83eee05 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.521460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 967/1942] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:01.523255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.526079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.526949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.527232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.527508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] PATH_INFO: `/v3/projects/7629c35635f943c9801bb5162f8e1dba` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.528829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7629c35635f943c9801bb5162f8e1dba)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.531712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.535153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cacde-f181-47d9-af1b-c335e8b482f0 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.540435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.541064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.542878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.543352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.550315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.553389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.569654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 968/1943] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:01.570893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.587090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253abb-6321-4ef6-b39a-030057ecf2b2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.591480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:01.595688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.597292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.597807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.598269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] PATH_INFO: `/v3/projects/9f035fd00424417999d1c6e3535c260a/users/4c16cb1dbde14d15836c1be2ad2292e2/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.602195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f035fd00424417999d1c6e3535c260a, user_id=4c16cb1dbde14d15836c1be2ad2292e2, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.605379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.608004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7629c35635f943c9801bb5162f8e1dba', 'request_id': 'req-9328093c-b98a-4b71-bd22-78e6e8206784'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.614264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7629c35635f943c9801bb5162f8e1dba', 'request_id': 'req-9328093c-b98a-4b71-bd22-78e6e8206784'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.619528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 969/1944] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:01 2022] PUT /identity/v3/projects/9f035fd00424417999d1c6e3535c260a/users/4c16cb1dbde14d15836c1be2ad2292e2/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:01.620623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.633310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7629c35635f943c9801bb5162f8e1dba', 'request_id': 'req-9328093c-b98a-4b71-bd22-78e6e8206784'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.649836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] The token cache is being invalidate because project 7629c35635f943c9801bb5162f8e1dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:01.650365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.651209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.652877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 976/1945] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:01 2022] DELETE /identity/v3/projects/7629c35635f943c9801bb5162f8e1dba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:01.653915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.655560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.705339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bbd3a-22da-48b1-85e2-816aed66b633 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.711544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.712174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.712451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.712722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.713372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:01.713680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.715402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a5c2d-bd1f-478f-a71b-b4263a5b8cdf admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.730936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 970/1946] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:01.730936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.730936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.730936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.743390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328093c-b98a-4b71-bd22-78e6e8206784 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.749108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.749765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.750044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.750384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.751357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.753212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.759854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] MFA Rules not processed for user `4c16cb1dbde14d15836c1be2ad2292e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:01.761157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.765448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:01.765666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 977/1947] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:01.767287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.769261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.784912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139eea-7307-43aa-8c28-b4bdd981b303 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.789983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.790631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.790945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.791221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] PATH_INFO: `/v3/users/ec0d205554ab4d2984773571908a6e68` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.792491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0d205554ab4d2984773571908a6e68)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.794442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.850044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 971/1948] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:01.850919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.852657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.856681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0d205554ab4d2984773571908a6e68'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.857423 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0d205554ab4d2984773571908a6e68'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.865376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0d205554ab4d2984773571908a6e68'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.869288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e146-555c-4f4f-8235-8674e4040e3e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:01.879488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:01.879948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0d205554ab4d2984773571908a6e68'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.880231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:01.880461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:01.880742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:01.880866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0d205554ab4d2984773571908a6e68'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:01.881415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:01.883387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:01.913234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 978/1949] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:01 2022] DELETE /identity/v3/users/ec0d205554ab4d2984773571908a6e68 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:01.914155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.917453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.932726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 972/1950] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:01 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:01.937548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:01.939418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:01.972731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:02.008652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c0be-f444-4d58-83ca-e53564fb20af admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.012121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.012852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.013235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.013740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.015845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.018393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13c71-3b9e-46c6-a76b-6a90b1d6df74 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.097691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ced008-233b-4633-b9cd-4fb9eb2fd0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.099125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ced008-233b-4633-b9cd-4fb9eb2fd0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.099807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ced008-233b-4633-b9cd-4fb9eb2fd0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.100273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ced008-233b-4633-b9cd-4fb9eb2fd0fb admin admin] PATH_INFO: `/v3/projects/dad5b7b7d646441bb761efb38bc0185e/users/09040828d9774f3e9eaf9cd33f74b6d7/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.101792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.103761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.125817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ced008-233b-4633-b9cd-4fb9eb2fd0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad5b7b7d646441bb761efb38bc0185e, user_id=09040828d9774f3e9eaf9cd33f74b6d7, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.129891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ced008-233b-4633-b9cd-4fb9eb2fd0fb admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.134427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 973/1951] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:02.135902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.158815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.177536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 979/1952] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:01 2022] PUT /identity/v3/projects/dad5b7b7d646441bb761efb38bc0185e/users/09040828d9774f3e9eaf9cd33f74b6d7/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:02.180295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.182702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.183195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.197814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e886cab-e71a-47ec-aba8-3060444c947f service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.266981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] MFA Rules not processed for user `09040828d9774f3e9eaf9cd33f74b6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:02.268239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.272115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:02.355374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.355374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.355374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.355374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.356050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.361942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.418482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 974/1953] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:02 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:02.422808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.431376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 980/1954] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:02.438614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0890d2-eca8-43c7-bc94-9e8ff9a43274 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.441933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.443405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.457645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.458284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.458561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.458861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.461126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.463085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.487762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 975/1955] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:02.488750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.500068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadc7bc-9a9d-4283-90b8-4a13d7cb6132 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.505457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.506302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.506756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.507199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.508191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.510180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.525621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 976/1956] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:02.533345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.551019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:02.554642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cd320-3b03-457b-8b16-573b863c7654 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.560556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42a23-fdbe-47fb-bff0-7c5cf9c249fd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.568250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14d35-cfa3-40be-88d3-bdb138f9f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.568952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14d35-cfa3-40be-88d3-bdb138f9f31c admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.569235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14d35-cfa3-40be-88d3-bdb138f9f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.569580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14d35-cfa3-40be-88d3-bdb138f9f31c admin admin] PATH_INFO: `/v3/projects/8d1d68e29a9b41abad89c52683ea2cd1/users/ec004042ec80492c9bd4fffbaeccba3c/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.579855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.580685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.581108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.582608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.592901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14d35-cfa3-40be-88d3-bdb138f9f31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1d68e29a9b41abad89c52683ea2cd1, user_id=ec004042ec80492c9bd4fffbaeccba3c, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.607784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14d35-cfa3-40be-88d3-bdb138f9f31c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.607987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.607987 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.618796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 981/1957] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:02.619672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.621080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.625811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 977/1958] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:02 2022] PUT /identity/v3/projects/8d1d68e29a9b41abad89c52683ea2cd1/users/ec004042ec80492c9bd4fffbaeccba3c/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:02.644746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.644746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.644746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.652391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc1ea-c590-4669-9b03-d21f4179e7cf service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.686213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] MFA Rules not processed for user `ec004042ec80492c9bd4fffbaeccba3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:02.687844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.756786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.757731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.758163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.758489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] PATH_INFO: `/v3/projects/624fccb1b18646b2b2970f1bfda628bc` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.759715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624fccb1b18646b2b2970f1bfda628bc)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.761734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.796428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 978/1959] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:02.801210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.802571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.816569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e28900-f92e-4c8f-8fdb-60bdbf84d7de None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.826656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624fccb1b18646b2b2970f1bfda628bc', 'request_id': 'req-9d92ad31-24a8-4852-9863-f7c0ec3d3015'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:02.834111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624fccb1b18646b2b2970f1bfda628bc', 'request_id': 'req-9d92ad31-24a8-4852-9863-f7c0ec3d3015'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:02.841382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624fccb1b18646b2b2970f1bfda628bc', 'request_id': 'req-9d92ad31-24a8-4852-9863-f7c0ec3d3015'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:02.857722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] The token cache is being invalidate because project 624fccb1b18646b2b2970f1bfda628bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:02.858046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:02.858888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:02.861318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 982/1960] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:02 2022] DELETE /identity/v3/projects/624fccb1b18646b2b2970f1bfda628bc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:02.865578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:02.867209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:02.881845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.882715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.883109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.883557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] PATH_INFO: `/v3/users/44a699fba10a44a38e6c7a4586bf32dc` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.884989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a699fba10a44a38e6c7a4586bf32dc)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.899958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.905570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:02.951022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92ad31-24a8-4852-9863-f7c0ec3d3015 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:02.958079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42f0b-5cbc-43ce-bebc-f9d649d041c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:02.958774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42f0b-5cbc-43ce-bebc-f9d649d041c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:02.959057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42f0b-5cbc-43ce-bebc-f9d649d041c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:02.959328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42f0b-5cbc-43ce-bebc-f9d649d041c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:02.959996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42f0b-5cbc-43ce-bebc-f9d649d041c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:02.962016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42f0b-5cbc-43ce-bebc-f9d649d041c8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:02.990896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a699fba10a44a38e6c7a4586bf32dc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:02.993214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a699fba10a44a38e6c7a4586bf32dc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:03.001622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 983/1961] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:02 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:03.003117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12178-8aca-4037-a18c-027318819dc0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.003408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12178-8aca-4037-a18c-027318819dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.003690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12178-8aca-4037-a18c-027318819dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.018319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a699fba10a44a38e6c7a4586bf32dc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:03.021055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:03.030581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-7ce12178-8aca-4037-a18c-027318819dc0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:03.033801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7ce12178-8aca-4037-a18c-027318819dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.059446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a699fba10a44a38e6c7a4586bf32dc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:03.060274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a699fba10a44a38e6c7a4586bf32dc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:03.083602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 979/1962] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:02 2022] DELETE /identity/v3/users/44a699fba10a44a38e6c7a4586bf32dc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:03.084918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.086803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.161984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 984/1963] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:03.163568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1372f0-8b8b-4fc3-b07b-4c6422a24036 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.163953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1372f0-8b8b-4fc3-b07b-4c6422a24036 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.164321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1372f0-8b8b-4fc3-b07b-4c6422a24036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.200554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ea1372f0-8b8b-4fc3-b07b-4c6422a24036 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:03.203009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ea1372f0-8b8b-4fc3-b07b-4c6422a24036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.219840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 985/1964] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:03.219980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2764c-1bc2-40ba-b234-296830100d72 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.220077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.220077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.220077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.238516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.239287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.239287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.239574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.240219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.245157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:03.246170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.246299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.265681 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 986/1965] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:03.266862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.270264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.287083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 980/1966] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:03.291210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.314081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9901a-13bc-4399-898f-51c20577151e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.319782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.320410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.320691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.320973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.321630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:03.321962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.324534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.340267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 981/1967] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:03.341192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.347505 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e0b2a-2a21-4046-b45c-15af0eed023b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.353327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.353327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.353327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.353327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.357937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde281-ef95-4253-84a5-252f9912b1b0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.363141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.363264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.364138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.364545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.365638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.365840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.365922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.368689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.375541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 987/1968] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:03.376303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.389930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 982/1969] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:03.390197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f049-4458-4e09-b843-deae08e92ac4 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.391645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.392608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.393293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.393630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.393969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.395202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.397183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.406582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8274d-07c3-4a18-8f73-c070ee85b3b9 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.413371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.414059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.414341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.414617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] PATH_INFO: `/v3/projects/09660d3a8aaf41f79e1403233075b4b6/users/3587fe7395bc42359b8962ac256f85b1/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.433744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 988/1970] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:03.437665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09660d3a8aaf41f79e1403233075b4b6, user_id=3587fe7395bc42359b8962ac256f85b1, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.438939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.440700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.469977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 983/1971] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:03 2022] PUT /identity/v3/projects/09660d3a8aaf41f79e1403233075b4b6/users/3587fe7395bc42359b8962ac256f85b1/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:03.473988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.515166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b2f7f-da2b-48ab-a10c-f7b6cf375d48 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.524704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:03.536844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:03.576998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f788ec9-6ad2-4403-bb98-4ab9b63e96bc admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.584138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.584770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.585164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.585513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.586108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.588842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.600917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.605101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 984/1972] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:03.605455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.605659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.606036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.606784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.609858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.611019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.629714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0ec3c-9bf8-43c9-9322-6b32cae2d398 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.634828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6323e6-f58b-4328-97fd-2c561d593fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.635505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6323e6-f58b-4328-97fd-2c561d593fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.635828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6323e6-f58b-4328-97fd-2c561d593fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.636113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6323e6-f58b-4328-97fd-2c561d593fd7 admin admin] PATH_INFO: `/v3/projects/09660d3a8aaf41f79e1403233075b4b6/users/3587fe7395bc42359b8962ac256f85b1/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.638116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6323e6-f58b-4328-97fd-2c561d593fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09660d3a8aaf41f79e1403233075b4b6, user_id=3587fe7395bc42359b8962ac256f85b1, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.641412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6323e6-f58b-4328-97fd-2c561d593fd7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.655119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 985/1973] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:03 2022] PUT /identity/v3/projects/09660d3a8aaf41f79e1403233075b4b6/users/3587fe7395bc42359b8962ac256f85b1/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:03.669947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 989/1974] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:03.670449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.670449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.670449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.679021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.684332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed5a6-8ab1-430a-97ce-9d7bbd1e232c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.756938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] MFA Rules not processed for user `3587fe7395bc42359b8962ac256f85b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:03.760308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.761719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.762350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.762625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.762928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.763573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.765175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.775972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 990/1975] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:03.780515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.795722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8bcb-b514-4506-8624-de4580b241b0 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.801070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.801922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.802673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.803013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.803885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.805509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.860747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 991/1976] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:03.865670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.889819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edc7c5-a57a-4bd5-8139-1cbb43b1eeb1 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:03.900291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712ea6c-169d-4e8e-b3c8-70601f8df30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:03.903191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712ea6c-169d-4e8e-b3c8-70601f8df30c admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.903479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712ea6c-169d-4e8e-b3c8-70601f8df30c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:03.903758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712ea6c-169d-4e8e-b3c8-70601f8df30c admin admin] PATH_INFO: `/v3/projects/e45d9a27d6d4417abb5e89d64ac3e149/users/89e6b305449a479eb834276347d731f2/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:03.945576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 986/1977] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:03.946204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712ea6c-169d-4e8e-b3c8-70601f8df30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45d9a27d6d4417abb5e89d64ac3e149, user_id=89e6b305449a479eb834276347d731f2, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:03.957905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712ea6c-169d-4e8e-b3c8-70601f8df30c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:03.960929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:03.967413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:03.994765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 992/1978] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:03 2022] PUT /identity/v3/projects/e45d9a27d6d4417abb5e89d64ac3e149/users/89e6b305449a479eb834276347d731f2/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:03.996824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:03.997246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.001060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.041301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] MFA Rules not processed for user `89e6b305449a479eb834276347d731f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:04.042542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:04.059929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0bfb6-72cd-41cb-a1cd-682b21756886 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.122846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 993/1979] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:04.123843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.127422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:04.132529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:04.134503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:04.143566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.144187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.144468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.144765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.213466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc21f9c-066c-4da7-8d20-b5f453be9e3e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.218499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.220665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.220665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.220665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] PATH_INFO: `/v3/projects/bac9360c68f14390b5f5e91fc3731a8e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.222139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac9360c68f14390b5f5e91fc3731a8e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.224312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.230334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.231832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.242944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 987/1980] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:04.243731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.255294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a0ae-87c2-4b86-816b-6a3fd827befe service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.261809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.263043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.263468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.263780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.264461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.266946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.302635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac9360c68f14390b5f5e91fc3731a8e', 'request_id': 'req-fd1298af-008a-47e2-aed6-8ca2b6e3341a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.309850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 988/1981] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:04 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:04.311038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.314122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac9360c68f14390b5f5e91fc3731a8e', 'request_id': 'req-fd1298af-008a-47e2-aed6-8ca2b6e3341a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.335338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac9360c68f14390b5f5e91fc3731a8e', 'request_id': 'req-fd1298af-008a-47e2-aed6-8ca2b6e3341a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.358189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] The token cache is being invalidate because project bac9360c68f14390b5f5e91fc3731a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:04.359321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.360397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.375104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 994/1982] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:04 2022] DELETE /identity/v3/projects/bac9360c68f14390b5f5e91fc3731a8e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:04.378900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.381039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:04.443180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bab0-7423-4fe8-b5bc-ef6b12f9250b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.449008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.449780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.450045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.450457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.451568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.454322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.482721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 989/1983] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:04 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:04.482939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1298af-008a-47e2-aed6-8ca2b6e3341a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.487282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.489288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.489951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.490326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.490612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] PATH_INFO: `/v3/users/4c16cb1dbde14d15836c1be2ad2292e2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.491572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:04.491931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c16cb1dbde14d15836c1be2ad2292e2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.494007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.509753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b248a-a949-4702-8e9e-c805abe0633a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.518029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.518786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.519086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.519486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.520138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.521939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.539780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 990/1984] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:04.543090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:04.543954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.558833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40696917-dd76-4fd7-84a4-dc38ee94f5ba admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.563678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.564635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.564985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.565637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] PATH_INFO: `/v3/projects/6988724078904b47b1c3feea3ec9fd32/users/919334a994174172abd4d30f03f9dd3d/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.567444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c16cb1dbde14d15836c1be2ad2292e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.568240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c16cb1dbde14d15836c1be2ad2292e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.578345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c16cb1dbde14d15836c1be2ad2292e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.586144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6988724078904b47b1c3feea3ec9fd32, user_id=919334a994174172abd4d30f03f9dd3d, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.588849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.596989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c16cb1dbde14d15836c1be2ad2292e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.597799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c16cb1dbde14d15836c1be2ad2292e2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:04.612130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 991/1985] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:04 2022] PUT /identity/v3/projects/6988724078904b47b1c3feea3ec9fd32/users/919334a994174172abd4d30f03f9dd3d/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:04.616279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.620918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 995/1986] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:04 2022] DELETE /identity/v3/users/4c16cb1dbde14d15836c1be2ad2292e2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:04.621933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:04.666367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:04.717411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb54a01-f4c6-44b7-a35b-470fe7a81cc4 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.822336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.822915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.823193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.825288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.825828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.829079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.842339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 992/1987] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:04.846555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.859813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a4e36-a14a-477e-9c83-dba7c6388a90 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.863832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:04.864761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2042e3f-aca6-4a85-8d64-963df1cdd0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:04.865466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042e3f-aca6-4a85-8d64-963df1cdd0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.865716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042e3f-aca6-4a85-8d64-963df1cdd0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.866005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2042e3f-aca6-4a85-8d64-963df1cdd0b2 admin admin] PATH_INFO: `/v3/projects/6988724078904b47b1c3feea3ec9fd32/users/919334a994174172abd4d30f03f9dd3d/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.868270 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2042e3f-aca6-4a85-8d64-963df1cdd0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6988724078904b47b1c3feea3ec9fd32, user_id=919334a994174172abd4d30f03f9dd3d, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:04.868392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:04.871604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2042e3f-aca6-4a85-8d64-963df1cdd0b2 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:04.887097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 996/1988] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:04 2022] PUT /identity/v3/projects/6988724078904b47b1c3feea3ec9fd32/users/919334a994174172abd4d30f03f9dd3d/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:04.890776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568181e8-b2bc-4fba-b054-0a6b3bde9087 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:04.898732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:04.899052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:04.899334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:04.931314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] MFA Rules not processed for user `919334a994174172abd4d30f03f9dd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:04.933168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.028218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.030291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.030596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.030972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] PATH_INFO: `/v3/users/ec004042ec80492c9bd4fffbaeccba3c` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.032303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec004042ec80492c9bd4fffbaeccba3c)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.034500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.087835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 997/1989] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:05.092894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.094854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.106338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec004042ec80492c9bd4fffbaeccba3c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.107287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec004042ec80492c9bd4fffbaeccba3c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.113342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff3d80-d585-4881-8d7a-e64d17155d25 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.117001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec004042ec80492c9bd4fffbaeccba3c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.118636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.119600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.120020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.120537 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] PATH_INFO: `/v3/projects/9f035fd00424417999d1c6e3535c260a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.122091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f035fd00424417999d1c6e3535c260a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.124531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.136188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec004042ec80492c9bd4fffbaeccba3c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.136889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec004042ec80492c9bd4fffbaeccba3c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.141024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:05.163259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 993/1990] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:04 2022] DELETE /identity/v3/users/ec004042ec80492c9bd4fffbaeccba3c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:05.164436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.167512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.219906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f035fd00424417999d1c6e3535c260a', 'request_id': 'req-983ac5e1-1501-4509-a456-c22ecd6c989f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.232120 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f035fd00424417999d1c6e3535c260a', 'request_id': 'req-983ac5e1-1501-4509-a456-c22ecd6c989f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.249345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72aa63-2ff3-463f-91da-fab5bfdfed0f admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.258894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f035fd00424417999d1c6e3535c260a', 'request_id': 'req-983ac5e1-1501-4509-a456-c22ecd6c989f'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.275295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] The token cache is being invalidate because project 9f035fd00424417999d1c6e3535c260a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:05.276006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.276810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-983ac5e1-1501-4509-a456-c22ecd6c989f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:05.282859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 998/1991] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:05 2022] DELETE /identity/v3/projects/9f035fd00424417999d1c6e3535c260a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:05.282859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c156968-0262-43cf-8189-b4024c2421a1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.282859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c156968-0262-43cf-8189-b4024c2421a1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.282859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c156968-0262-43cf-8189-b4024c2421a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.301802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:05.311276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-7c156968-0262-43cf-8189-b4024c2421a1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:05.313133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7c156968-0262-43cf-8189-b4024c2421a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.327839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.328624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.328936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.329323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.331610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.396786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 999/1992] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:05.398076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.398362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.398631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.418336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.419601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00404eec-36f2-4dd8-85ef-2233072ac95a service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.429885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:05.432299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.442382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1000/1993] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:05.443492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.445599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.451727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 994/1994] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:05.456983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.457703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.458407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.494637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:05.495881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.540637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 995/1995] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:05.551906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.554743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee89a3-b66b-4e24-afdb-dd1d44fbc520 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.558723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.559534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.559900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.560307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.575000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.575000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.575179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845cc37-d431-4567-bac5-e1603e6bcb37 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.580028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.580814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.581812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.581947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.583086 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:05.583530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.585417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.592815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1001/1996] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:05.593745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.595929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.600453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 996/1997] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:05.605736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.613788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c33b-6557-4856-93f6-7ca4bdf0e3cf service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.619167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.619813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.620314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332304-b495-43f8-8547-c504b43681cb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.620524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.620798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.623055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:05.629555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.630271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.631353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.631705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.632577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.634981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.678341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 997/1998] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:05 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:05.694359 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.718411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:05.748123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.750612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.764237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1002/1999] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:05.774719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaed31-cc95-4339-b675-ae02df72d56a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.781607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.782296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.782510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.782814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.783454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.789426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.817668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 998/2000] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:05 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:05.821755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.834929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b11ab6-2b0b-4bf4-becf-2638f37d2840 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.842355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.843333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.843612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.843883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.844731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.846491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.859544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1003/2001] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:05.863607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.877954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78a13-b494-4e1d-b24d-b9a34216d703 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.888547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f42b2a-c010-4209-819b-d5def70f06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.889821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f42b2a-c010-4209-819b-d5def70f06f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.890300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f42b2a-c010-4209-819b-d5def70f06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.890814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f42b2a-c010-4209-819b-d5def70f06f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.891734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f42b2a-c010-4209-819b-d5def70f06f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.894240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f42b2a-c010-4209-819b-d5def70f06f4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.910361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 999/2002] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:05.911132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:05.924932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54926fc-736f-4c60-85ac-c4b3b7722055 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:05.937876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:05.938897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:05.939241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:05.939572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] PATH_INFO: `/v3/projects/1788f68118a148798af510058c0d981a/users/5459431a4b014ed999e5525dd6ee8e97/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:05.968169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1788f68118a148798af510058c0d981a, user_id=5459431a4b014ed999e5525dd6ee8e97, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:05.970927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:05.995222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1004/2003] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:05 2022] PUT /identity/v3/projects/1788f68118a148798af510058c0d981a/users/5459431a4b014ed999e5525dd6ee8e97/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:06.008465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.008850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.009326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.039936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] MFA Rules not processed for user `5459431a4b014ed999e5525dd6ee8e97`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:06.041601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.097337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.099694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.112371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:06.158490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1000/2004] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:06.163392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.198887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97553b5-f4dc-4f39-951a-9069e7caefc7 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.207739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.208524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.208870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.209302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] PATH_INFO: `/v3/projects/8d1d68e29a9b41abad89c52683ea2cd1` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.210714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1d68e29a9b41abad89c52683ea2cd1)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.213247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.293901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1d68e29a9b41abad89c52683ea2cd1', 'request_id': 'req-c9340362-1c98-4944-8d50-927f3c396201'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.301617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1d68e29a9b41abad89c52683ea2cd1', 'request_id': 'req-c9340362-1c98-4944-8d50-927f3c396201'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.306774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178708be-8f8a-4516-b1e6-da90a1b63d2d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.308402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1d68e29a9b41abad89c52683ea2cd1', 'request_id': 'req-c9340362-1c98-4944-8d50-927f3c396201'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.324694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] The token cache is being invalidate because project 8d1d68e29a9b41abad89c52683ea2cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:06.325056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.326057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.327973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1005/2005] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:06 2022] DELETE /identity/v3/projects/8d1d68e29a9b41abad89c52683ea2cd1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:06.328543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.329835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.359655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:06.393598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.394218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.394495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.394792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.395431 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.397391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.409372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340362-1c98-4944-8d50-927f3c396201 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.415944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.416595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.416874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.417146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] PATH_INFO: `/v3/users/ea118ecaded443c7ac0178db6beb16ac` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.418504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea118ecaded443c7ac0178db6beb16ac)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.421146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.435830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1001/2006] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:06 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:49:06.435830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.435830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.474011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:06.481284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea118ecaded443c7ac0178db6beb16ac'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.482426 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea118ecaded443c7ac0178db6beb16ac'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.490532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea118ecaded443c7ac0178db6beb16ac'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.504187 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea118ecaded443c7ac0178db6beb16ac'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.505434 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea118ecaded443c7ac0178db6beb16ac'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.512440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4bcf-401d-47c9-a3ee-cd9cafaf36cb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.517745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.518388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.518673 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.518980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] PATH_INFO: `/v3/users/3587fe7395bc42359b8962ac256f85b1` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.520109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3587fe7395bc42359b8962ac256f85b1)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.521087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1006/2007] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:06 2022] DELETE /identity/v3/users/ea118ecaded443c7ac0178db6beb16ac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:06.522185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.525347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.526838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.583545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3587fe7395bc42359b8962ac256f85b1'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.584234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3587fe7395bc42359b8962ac256f85b1'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.591584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3587fe7395bc42359b8962ac256f85b1'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.603910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3587fe7395bc42359b8962ac256f85b1'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.604638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3587fe7395bc42359b8962ac256f85b1'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.613838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91baac8-a38d-42a5-af7c-d4936124dbb3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.618166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1002/2008] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:06 2022] DELETE /identity/v3/users/3587fe7395bc42359b8962ac256f85b1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:06.619202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.620530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.629480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.630148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.630583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.630911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] PATH_INFO: `/v3/users/09040828d9774f3e9eaf9cd33f74b6d7` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.635415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09040828d9774f3e9eaf9cd33f74b6d7)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.637373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.671538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:06.713992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb83f-f4ab-48e4-acb4-78469f5dd63b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.719821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3a2cb-8b57-45d4-8834-2b70cb30651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.720213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09040828d9774f3e9eaf9cd33f74b6d7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.720627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3a2cb-8b57-45d4-8834-2b70cb30651d admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.720805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3a2cb-8b57-45d4-8834-2b70cb30651d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.721130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3a2cb-8b57-45d4-8834-2b70cb30651d admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.721768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3a2cb-8b57-45d4-8834-2b70cb30651d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.722213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09040828d9774f3e9eaf9cd33f74b6d7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.723986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3a2cb-8b57-45d4-8834-2b70cb30651d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.732108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09040828d9774f3e9eaf9cd33f74b6d7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.752242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09040828d9774f3e9eaf9cd33f74b6d7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.754493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09040828d9774f3e9eaf9cd33f74b6d7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:06.763275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1003/2009] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:06 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:06.765190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e847802-d4bc-481d-b384-c32c5af64ff5 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.765417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e847802-d4bc-481d-b384-c32c5af64ff5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.765688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e847802-d4bc-481d-b384-c32c5af64ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.780548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1007/2010] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:06 2022] DELETE /identity/v3/users/09040828d9774f3e9eaf9cd33f74b6d7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:06.785396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.786467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.801765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6e847802-d4bc-481d-b384-c32c5af64ff5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:06.803577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6e847802-d4bc-481d-b384-c32c5af64ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.851841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:06.888768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4f1c-7d49-4798-adc8-9909b0442a2d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.896755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1004/2011] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:06.896755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.896755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.896755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.901148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.901809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.902094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.902364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.903204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.905079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.920449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1008/2012] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:06.922215 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.924965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:06.926451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.926597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:06.936837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1005/2013] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:06.937855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:06.949598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e909d-4b30-407c-a3ce-f57145b0b8cf None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:06.955620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:06.956558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:06.956842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:06.957477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] PATH_INFO: `/v3/projects/14ea28b3ccf6401c8af75f1e40e1b64d/users/ea7da157cae5425a9b4a4ec770af44f2/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:06.975665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ea28b3ccf6401c8af75f1e40e1b64d, user_id=ea7da157cae5425a9b4a4ec770af44f2, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:06.978667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:06.996391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5302-af3e-4e8c-a9fa-a934d592f19a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.000011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1006/2014] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:06 2022] PUT /identity/v3/projects/14ea28b3ccf6401c8af75f1e40e1b64d/users/ea7da157cae5425a9b4a4ec770af44f2/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:07.000958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.081502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.082940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.083512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.084188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.085301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80668e61-7eee-4760-82a2-f6fa98abd79f admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.089648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.090656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.090656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.090987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.164475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:07.182583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.188390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.190392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.194747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.207744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1009/2015] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:07.208565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.209909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.225385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1007/2016] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:07.225385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.225793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad91dc5-b490-4b21-95b4-a41552a4a25e service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.229025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.229170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603278-7cfb-48f9-b9e7-ad672ec0173a service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.229995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.230325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.230534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] PATH_INFO: `/v3/projects/09660d3a8aaf41f79e1403233075b4b6` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.231746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09660d3a8aaf41f79e1403233075b4b6)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.233609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.235085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.235899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.236509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.236806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.237485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.239112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.249557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1008/2017] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:07.253685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.266823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f91fb-e0f1-4291-a1f9-704f95a810c3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.277281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adf71c-7e8c-41d5-adc9-f49118c085a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.277917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adf71c-7e8c-41d5-adc9-f49118c085a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.278558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adf71c-7e8c-41d5-adc9-f49118c085a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.278665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adf71c-7e8c-41d5-adc9-f49118c085a4 admin admin] PATH_INFO: `/v3/projects/14ea28b3ccf6401c8af75f1e40e1b64d/users/ea7da157cae5425a9b4a4ec770af44f2/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.280833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adf71c-7e8c-41d5-adc9-f49118c085a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ea28b3ccf6401c8af75f1e40e1b64d, user_id=ea7da157cae5425a9b4a4ec770af44f2, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.284195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adf71c-7e8c-41d5-adc9-f49118c085a4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.296463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:07.322839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09660d3a8aaf41f79e1403233075b4b6', 'request_id': 'req-12463b71-845c-41c3-a69b-1d2542e1229d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.327134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1009/2018] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:07 2022] PUT /identity/v3/projects/14ea28b3ccf6401c8af75f1e40e1b64d/users/ea7da157cae5425a9b4a4ec770af44f2/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:07.331315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09660d3a8aaf41f79e1403233075b4b6', 'request_id': 'req-12463b71-845c-41c3-a69b-1d2542e1229d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.335065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.335150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.335462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.344947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09660d3a8aaf41f79e1403233075b4b6', 'request_id': 'req-12463b71-845c-41c3-a69b-1d2542e1229d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.369501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] The token cache is being invalidate because project 09660d3a8aaf41f79e1403233075b4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:07.369804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.370597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12463b71-845c-41c3-a69b-1d2542e1229d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.386103 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] MFA Rules not processed for user `ea7da157cae5425a9b4a4ec770af44f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:07.387669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.391403 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1010/2019] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:07 2022] DELETE /identity/v3/projects/09660d3a8aaf41f79e1403233075b4b6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:07.396152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65cfd-592b-4d41-bdb2-94ec5709ddd4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.396439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65cfd-592b-4d41-bdb2-94ec5709ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.397443 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65cfd-592b-4d41-bdb2-94ec5709ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.427571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b6c65cfd-592b-4d41-bdb2-94ec5709ddd4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:07.428803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b6c65cfd-592b-4d41-bdb2-94ec5709ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.586875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1010/2020] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:07.589795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.591909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.615474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1011/2021] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:07.626128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.626353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.626637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.674702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:07.678195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.709539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507032-e96e-4a8e-9d5c-8f611cbad338 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.719172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1012/2022] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:07.720385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.721133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.721702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.721805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.722034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.722299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.740614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df2ae8-f010-4c4d-b7b3-8530e8e535e1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.746776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.747760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.747897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.748804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.749205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] PATH_INFO: `/v3/projects/dad5b7b7d646441bb761efb38bc0185e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.750008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.751310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad5b7b7d646441bb761efb38bc0185e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.761201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.762803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1011/2023] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:07.763828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.781042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a824b18-eb00-4ad5-9aef-f7327f701b19 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.793737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.794534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.794841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.795385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.795747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:07.796076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.797847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.817642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1012/2024] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:07.822558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.840210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d6e2-b5a0-42d0-85c7-c1eb7e9dd911 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:07.858370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad5b7b7d646441bb761efb38bc0185e', 'request_id': 'req-66a122f5-e32b-481a-a619-b212e6108f79'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.877078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad5b7b7d646441bb761efb38bc0185e', 'request_id': 'req-66a122f5-e32b-481a-a619-b212e6108f79'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.886254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad5b7b7d646441bb761efb38bc0185e', 'request_id': 'req-66a122f5-e32b-481a-a619-b212e6108f79'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.902845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] The token cache is being invalidate because project dad5b7b7d646441bb761efb38bc0185e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:07.903684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.904561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:07.906315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1013/2025] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:07 2022] DELETE /identity/v3/projects/dad5b7b7d646441bb761efb38bc0185e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:07.910747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.912235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:07.912396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:07.948662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:07.949297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:07.949576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:07.949846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:07.950548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:07.952812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:07.965627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:07.986737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1013/2026] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:07 2022] POST /identity/v3/projects => generated 359 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:07.986737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:07.987884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.000386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a122f5-e32b-481a-a619-b212e6108f79 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.070178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.071284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.071710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.072079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] PATH_INFO: `/v3/users/5459431a4b014ed999e5525dd6ee8e97` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.073614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5459431a4b014ed999e5525dd6ee8e97)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.075815 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.093627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c0de0-51bd-45ff-9197-c646e1e85897 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.100258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.101144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.101492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.102022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] PATH_INFO: `/v3/projects/078ba32475e34fb7b9c4623bb6af1ecd` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.103386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078ba32475e34fb7b9c4623bb6af1ecd)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.105779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.130223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5459431a4b014ed999e5525dd6ee8e97'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.130951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5459431a4b014ed999e5525dd6ee8e97'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.140372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5459431a4b014ed999e5525dd6ee8e97'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.153152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5459431a4b014ed999e5525dd6ee8e97'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.153900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6bd46d3a-e88a-40cb-b4bf-7f04c3503485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5459431a4b014ed999e5525dd6ee8e97'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.162968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078ba32475e34fb7b9c4623bb6af1ecd', 'request_id': 'req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.171327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078ba32475e34fb7b9c4623bb6af1ecd', 'request_id': 'req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.173045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1014/2027] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:07 2022] DELETE /identity/v3/users/5459431a4b014ed999e5525dd6ee8e97 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:08.176251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f7aa-ee9c-4397-8167-a2615325e357 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.176251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f7aa-ee9c-4397-8167-a2615325e357 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.176251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f7aa-ee9c-4397-8167-a2615325e357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.185244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078ba32475e34fb7b9c4623bb6af1ecd', 'request_id': 'req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.197095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a7a9f7aa-ee9c-4397-8167-a2615325e357 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:08.198418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a7a9f7aa-ee9c-4397-8167-a2615325e357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.200242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] The token cache is being invalidate because project 078ba32475e34fb7b9c4623bb6af1ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:08.200538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.201217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.202924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1014/2028] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:07 2022] DELETE /identity/v3/projects/078ba32475e34fb7b9c4623bb6af1ecd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:08.206180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.207041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.286214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:08.301365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1015/2029] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:08.303623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87bc8e-037d-4419-93fe-dcbb2fea0a38 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.308576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.309212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.309504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.310023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d983a-f7ee-4e17-8fac-f863ea79f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.310871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d983a-f7ee-4e17-8fac-f863ea79f8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.311327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d983a-f7ee-4e17-8fac-f863ea79f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.311799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d983a-f7ee-4e17-8fac-f863ea79f8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.312608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d983a-f7ee-4e17-8fac-f863ea79f8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.314812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d983a-f7ee-4e17-8fac-f863ea79f8b6 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.318462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:08.333425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:08.335350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.346968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1016/2030] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:08.346968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.347232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1015/2031] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:08 2022] POST /identity/v3/users => generated 280 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:08.348059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.349309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.349309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.356319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.369714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2346-d4ab-434c-af81-acc6f7de2e78 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.372461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:08.373688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.374854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.375578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.375985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.376209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] PATH_INFO: `/v3/users/65979738008544cd976d345a54f60e80` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.377476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=65979738008544cd976d345a54f60e80)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.379448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.382193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1016/2032] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:08.386239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.396367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebde08-e302-4f71-aa51-c65383ead71b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.401652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.402276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.402529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.402924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.403601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.405314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.417169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1017/2033] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:08.418839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.421191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.437115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65979738008544cd976d345a54f60e80'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.438144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65979738008544cd976d345a54f60e80'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.448595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65979738008544cd976d345a54f60e80'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.464858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65979738008544cd976d345a54f60e80'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.465700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65979738008544cd976d345a54f60e80'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:08.485346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1017/2034] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:08 2022] DELETE /identity/v3/users/65979738008544cd976d345a54f60e80 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:08.486326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.488001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.494032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd361-192f-4d0b-b0e0-5ec08324ced2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.555179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.557160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.557604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.558023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.560378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.596933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e31f7c-4bed-4a40-bed8-7f3b3d4894cb admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.604321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.605543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.605821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.606523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.607520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:08.607859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.611584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.630803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1018/2035] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:08.630803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.634729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.671514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c71971-6f28-4bb7-8eaa-111a0b13d76b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.686072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.686736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.687021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.687292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.688007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.689958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.695480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.700376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.718246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1019/2036] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:08.718620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.727327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1018/2037] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:08.730373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.763415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ea7d-63d4-4aaa-b3b4-0a3cdfc6937c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.782327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08f27-0bf5-4008-b6c2-25986e187eb7 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.787171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.787806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.788086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.788359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.789021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.790981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.804398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.805109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.805387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.805660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] PATH_INFO: `/v3/projects/aafaf345beec4a9f820223ddb6bacc0a/users/a529166f832a4e42a0e356ca2552f929/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.835949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafaf345beec4a9f820223ddb6bacc0a, user_id=a529166f832a4e42a0e356ca2552f929, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.838905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:08.856315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1020/2038] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:08 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:08.857947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.860269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:08.869174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1019/2039] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:08 2022] PUT /identity/v3/projects/aafaf345beec4a9f820223ddb6bacc0a/users/a529166f832a4e42a0e356ca2552f929/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:08.870158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:08.883900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:08.922402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:08.966598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509afd2-deb4-4347-b222-6407948ed2d3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:08.973125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:08.973844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:08.974169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:08.974790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] PATH_INFO: `/v3/users/89e6b305449a479eb834276347d731f2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:08.976228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e6b305449a479eb834276347d731f2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:08.980483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.046871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f872-926f-4531-930e-a8a05b7aa235 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.055321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168d4a-76ca-45e6-a92e-5cdf89d6a370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.056300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168d4a-76ca-45e6-a92e-5cdf89d6a370 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.056722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168d4a-76ca-45e6-a92e-5cdf89d6a370 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.057006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168d4a-76ca-45e6-a92e-5cdf89d6a370 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.057660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168d4a-76ca-45e6-a92e-5cdf89d6a370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.058230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e6b305449a479eb834276347d731f2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.060866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e6b305449a479eb834276347d731f2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.061014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168d4a-76ca-45e6-a92e-5cdf89d6a370 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.081976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e6b305449a479eb834276347d731f2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.114928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e6b305449a479eb834276347d731f2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.115544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1020/2040] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:08 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:09.116004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e6b305449a479eb834276347d731f2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.120733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.121035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.122809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.154770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1021/2041] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:08 2022] DELETE /identity/v3/users/89e6b305449a479eb834276347d731f2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:09.154770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.155303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.197500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] MFA Rules not processed for user `a529166f832a4e42a0e356ca2552f929`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:09.199383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.273611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e617-c9f0-45aa-9b39-7d9b4b4034ea admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.275169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1021/2042] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:09.278293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.278975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.279252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.279522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] PATH_INFO: `/v3/projects/c517ede232ca4ed99a379495ffa12efb` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.280637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c517ede232ca4ed99a379495ffa12efb)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.282867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.283775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.286950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.307052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f2be0-2cea-4397-81e9-5df4f7109fcc None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.312973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0631-a4f7-470a-be15-bb2e25432ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.314141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0631-a4f7-470a-be15-bb2e25432ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.314455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0631-a4f7-470a-be15-bb2e25432ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.314733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0631-a4f7-470a-be15-bb2e25432ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.315396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac0631-a4f7-470a-be15-bb2e25432ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.317143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac0631-a4f7-470a-be15-bb2e25432ae7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.327529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1022/2043] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:09.328750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.329037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.329309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.339929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c517ede232ca4ed99a379495ffa12efb', 'request_id': 'req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.341832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:09.347109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c517ede232ca4ed99a379495ffa12efb', 'request_id': 'req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.351280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:09.352522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.355375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c517ede232ca4ed99a379495ffa12efb', 'request_id': 'req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.369939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] The token cache is being invalidate because project c517ede232ca4ed99a379495ffa12efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:09.370155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.370839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.372363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1022/2044] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:09 2022] DELETE /identity/v3/projects/c517ede232ca4ed99a379495ffa12efb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:09.375885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.375885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.416876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1023/2045] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:09.417684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.421691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.435421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:09.439099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caae2a-8bea-4e23-b48a-2d0f1cc42ca5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.443969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.444616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.445140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.445277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] PATH_INFO: `/v3/projects/1788f68118a148798af510058c0d981a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.446342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1788f68118a148798af510058c0d981a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.448287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.482357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed432b7b-c550-45fc-944a-48fc4ba01a82 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.496599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1788f68118a148798af510058c0d981a', 'request_id': 'req-509f319c-5a6b-419a-92f1-69a219aeaf9b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.502957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1788f68118a148798af510058c0d981a', 'request_id': 'req-509f319c-5a6b-419a-92f1-69a219aeaf9b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.509317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1788f68118a148798af510058c0d981a', 'request_id': 'req-509f319c-5a6b-419a-92f1-69a219aeaf9b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.526385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] The token cache is being invalidate because project 1788f68118a148798af510058c0d981a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:09.526675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.527348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.529086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1023/2046] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:09 2022] DELETE /identity/v3/projects/1788f68118a148798af510058c0d981a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:09.529842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.531266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.535178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.535982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.536411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.536682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.538944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.602006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.603110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f319c-5a6b-419a-92f1-69a219aeaf9b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.603785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b44186-3f00-4f76-8c9e-08fbe7b0fddb service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.608057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.608952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.608952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.609770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.610168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.612042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.614621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1024/2047] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:09.615999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.616293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.616566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.622400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1024/2048] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:09.623251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.625286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.637697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:09.639598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:09.641064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.657250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1025/2049] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:09.657250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.658653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.671113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726866-5f61-47d3-bb52-05f79d2d312d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.675996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.676627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.676905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.677199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] PATH_INFO: `/v3/users/ea7da157cae5425a9b4a4ec770af44f2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.678822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7da157cae5425a9b4a4ec770af44f2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.680780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.691615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215665b-3c88-4268-807e-4b791b831101 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.695415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.696026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.696305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.696575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.698463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.716990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.718853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.729382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1025/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:09.730224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.739408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7da157cae5425a9b4a4ec770af44f2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.739675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c182ad-cdba-406e-8294-afebbb82f864 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.740331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7da157cae5425a9b4a4ec770af44f2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.745277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea75df8-4352-4fc2-93e1-7a08db1a2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.745960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75df8-4352-4fc2-93e1-7a08db1a2b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.746352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75df8-4352-4fc2-93e1-7a08db1a2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.746635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75df8-4352-4fc2-93e1-7a08db1a2b58 admin admin] PATH_INFO: `/v3/projects/3079868613284566a74a7ade64b8c5b6/users/8fbd61416abf447585df33946b601a55/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.749381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7da157cae5425a9b4a4ec770af44f2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.762930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:09.764316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7da157cae5425a9b4a4ec770af44f2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.765216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7da157cae5425a9b4a4ec770af44f2'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.768996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea75df8-4352-4fc2-93e1-7a08db1a2b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3079868613284566a74a7ade64b8c5b6, user_id=8fbd61416abf447585df33946b601a55, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.773368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea75df8-4352-4fc2-93e1-7a08db1a2b58 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.786054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1026/2051] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:09 2022] DELETE /identity/v3/users/ea7da157cae5425a9b4a4ec770af44f2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:09.787299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:09.787970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1026/2052] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:09 2022] PUT /identity/v3/projects/3079868613284566a74a7ade64b8c5b6/users/8fbd61416abf447585df33946b601a55/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:09.789285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d515-31cd-43b7-a035-c4cce7a77cca None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.789568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d515-31cd-43b7-a035-c4cce7a77cca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.789919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d515-31cd-43b7-a035-c4cce7a77cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.800772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.811744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b2f1d515-31cd-43b7-a035-c4cce7a77cca None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:09.813069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b2f1d515-31cd-43b7-a035-c4cce7a77cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.905057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010868c0-c284-4d87-bd9c-afadcdd0aa6c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:09.912728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:09.913702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.914091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.915730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] PATH_INFO: `/v3/users/a529166f832a4e42a0e356ca2552f929` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.916786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1027/2053] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:09.917231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a529166f832a4e42a0e356ca2552f929)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:09.918029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:09.918316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:09.918603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:09.919811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:09.948060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] MFA Rules not processed for user `8fbd61416abf447585df33946b601a55`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:09.949437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:09.996271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a529166f832a4e42a0e356ca2552f929'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:09.997860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a529166f832a4e42a0e356ca2552f929'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.016886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a529166f832a4e42a0e356ca2552f929'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.032502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a529166f832a4e42a0e356ca2552f929'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.033219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a529166f832a4e42a0e356ca2552f929'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.043530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1028/2054] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:10.044628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.059911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1027/2055] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:09 2022] DELETE /identity/v3/users/a529166f832a4e42a0e356ca2552f929 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:10.065241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.068198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.073095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a14d-406a-4060-95e5-fb394d040837 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.098343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:10.232483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.233150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.234414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916472a-2738-4ba7-ae51-507ad498c2f1 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.234996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.235231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.237791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:10.238241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.240299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b5b07-f312-4eff-9443-a6cb77289c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.241033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5b07-f312-4eff-9443-a6cb77289c1b admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.241417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5b07-f312-4eff-9443-a6cb77289c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.241887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5b07-f312-4eff-9443-a6cb77289c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.242500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.242877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b5b07-f312-4eff-9443-a6cb77289c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.244913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b5b07-f312-4eff-9443-a6cb77289c1b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.270172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:10.296786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1028/2056] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:10 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:10.298423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.298946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1029/2057] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:10.300244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.300693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.301352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.306584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.340644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425a5d-6877-4c72-b2a2-9269cb4f3448 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.348778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:10.349299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.460811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.461467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.461747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.462121 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] PATH_INFO: `/v3/projects/e45d9a27d6d4417abb5e89d64ac3e149` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.463309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45d9a27d6d4417abb5e89d64ac3e149)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.466173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.494012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1029/2058] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:10.495148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.511827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b3890-b22b-4e9c-a811-94bf0d2801f2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.520651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.522177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.522177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.522177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.522804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.526017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.545113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45d9a27d6d4417abb5e89d64ac3e149', 'request_id': 'req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.552386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45d9a27d6d4417abb5e89d64ac3e149', 'request_id': 'req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.556336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1030/2059] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:10 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:10.556336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.556336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.566817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45d9a27d6d4417abb5e89d64ac3e149', 'request_id': 'req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.570120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701f95-0c3b-468f-9ac9-0dd05bddc5a1 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.590153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] The token cache is being invalidate because project e45d9a27d6d4417abb5e89d64ac3e149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:10.591111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.592849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.598620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1030/2060] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:10 2022] DELETE /identity/v3/projects/e45d9a27d6d4417abb5e89d64ac3e149 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:10.599981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.601506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.650567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.651808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.652063 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.652331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.652966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.654918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.661162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:10.684117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0ecf6-8b7d-4c7d-a6d2-dc52d589cca5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.689340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.689959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.690230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.690496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.692225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1031/2061] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:10 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:10.693101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.694955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.696068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.725567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.728035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.741095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1031/2062] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:10.746565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.747992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.767572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c253025-f0f1-4f34-ab11-5f16d368d17a service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.779939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1dc51-420d-4016-92c4-3c3116a579a0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.788277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.788911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.789718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.789718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.790211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.792159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.795149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:10.809074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1032/2063] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:10.809074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.811045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.831518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de308a-fe86-4328-830d-ec5fa7e205bc admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:10.837102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.837746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.838024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.838295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] PATH_INFO: `/v3/projects/14ea28b3ccf6401c8af75f1e40e1b64d` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.839470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ea28b3ccf6401c8af75f1e40e1b64d)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.841479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.845271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:10.846224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:10.846538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:10.846849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] PATH_INFO: `/v3/users/919334a994174172abd4d30f03f9dd3d` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:10.848248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919334a994174172abd4d30f03f9dd3d)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:10.851447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:10.894646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ea28b3ccf6401c8af75f1e40e1b64d', 'request_id': 'req-ead9507f-630c-413e-880b-c904bf043a50'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.907457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ea28b3ccf6401c8af75f1e40e1b64d', 'request_id': 'req-ead9507f-630c-413e-880b-c904bf043a50'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.915312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919334a994174172abd4d30f03f9dd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.916372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919334a994174172abd4d30f03f9dd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.917743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ea28b3ccf6401c8af75f1e40e1b64d', 'request_id': 'req-ead9507f-630c-413e-880b-c904bf043a50'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.924943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919334a994174172abd4d30f03f9dd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.934922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] The token cache is being invalidate because project 14ea28b3ccf6401c8af75f1e40e1b64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:10.935320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.936115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.938641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1033/2064] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:10 2022] DELETE /identity/v3/projects/14ea28b3ccf6401c8af75f1e40e1b64d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:10.943437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.944840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:10.949391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919334a994174172abd4d30f03f9dd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.950305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919334a994174172abd4d30f03f9dd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:10.974955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1032/2065] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:10 2022] DELETE /identity/v3/users/919334a994174172abd4d30f03f9dd3d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:10.974955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:10.979550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.070557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9507f-630c-413e-880b-c904bf043a50 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.122346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006dce-f607-4368-b829-3a46f010c040 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.128736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe21eee-a8ab-4f77-bce6-114792332093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.129362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe21eee-a8ab-4f77-bce6-114792332093 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.129637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe21eee-a8ab-4f77-bce6-114792332093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.129903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe21eee-a8ab-4f77-bce6-114792332093 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.131146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe21eee-a8ab-4f77-bce6-114792332093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.132773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe21eee-a8ab-4f77-bce6-114792332093 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.135823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:11.151949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1033/2066] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:11.153351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.153639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.153911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.167454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.168229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.168502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.168759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.169401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.171448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.201752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1034/2067] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:10 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:11.201752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.202116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.203470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.221251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b115be-159c-469f-8e76-349e0b0bd448 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.229868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1034/2068] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.230984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.232426 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.237347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.238124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.238541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.239511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] PATH_INFO: `/v3/projects/1124bd95da524168bea2b0b52a07783e/users/fefd67a0349f403dbc67c9d0d5e9497e/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.256861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e549e-05ca-4a7d-91a7-86a9d632cac0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.260310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1124bd95da524168bea2b0b52a07783e, user_id=fefd67a0349f403dbc67c9d0d5e9497e, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.263977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.267068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:11.268946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf4f6-ebca-4508-be7f-ab24ac3b13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.269749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf4f6-ebca-4508-be7f-ab24ac3b13da admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.270041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf4f6-ebca-4508-be7f-ab24ac3b13da admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.270392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf4f6-ebca-4508-be7f-ab24ac3b13da admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.271438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf4f6-ebca-4508-be7f-ab24ac3b13da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.273290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf4f6-ebca-4508-be7f-ab24ac3b13da admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.284217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1035/2069] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:11 2022] PUT /identity/v3/projects/1124bd95da524168bea2b0b52a07783e/users/fefd67a0349f403dbc67c9d0d5e9497e/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:11.285484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.289770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1035/2070] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:11.289908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.290019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.290019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.290019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.311725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.313501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.370829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae81d-46d9-4b6d-b705-b975b2be1c57 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.376322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.377067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.377436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.377825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] PATH_INFO: `/v3/projects/aafaf345beec4a9f820223ddb6bacc0a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.379111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafaf345beec4a9f820223ddb6bacc0a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.381229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.387893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1036/2071] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.395061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.405891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e9207-ba94-490e-9b5a-8356e1b0306b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.411361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db23c9-a927-41a5-91a6-b18ee9725023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.411986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db23c9-a927-41a5-91a6-b18ee9725023 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.412285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db23c9-a927-41a5-91a6-b18ee9725023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.412535 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db23c9-a927-41a5-91a6-b18ee9725023 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.413675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db23c9-a927-41a5-91a6-b18ee9725023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.415105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db23c9-a927-41a5-91a6-b18ee9725023 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.426307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1037/2072] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:11.427835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.428117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.428387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.449904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafaf345beec4a9f820223ddb6bacc0a', 'request_id': 'req-9adc2939-ede3-4af3-908a-68bd9c85898d'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.455808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafaf345beec4a9f820223ddb6bacc0a', 'request_id': 'req-9adc2939-ede3-4af3-908a-68bd9c85898d'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.457542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] MFA Rules not processed for user `fefd67a0349f403dbc67c9d0d5e9497e`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.458986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.464551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafaf345beec4a9f820223ddb6bacc0a', 'request_id': 'req-9adc2939-ede3-4af3-908a-68bd9c85898d'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.476169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] The token cache is being invalidate because project aafaf345beec4a9f820223ddb6bacc0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:11.476459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.477109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.478650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1036/2073] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:11 2022] DELETE /identity/v3/projects/aafaf345beec4a9f820223ddb6bacc0a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:11.482578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.483854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.530631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1038/2074] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.531671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.533019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.564181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc2939-ede3-4af3-908a-68bd9c85898d admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.569141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.569742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.570020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.571030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.572195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:11.573299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.575167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.597656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1037/2075] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:11.597656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.598287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.610546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4b639-5f64-40f9-a684-9b47a2668221 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.615240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721b01-9880-49e7-a5c7-857b4e8a3195 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.617746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.618478 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.619031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.619309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] PATH_INFO: `/v3/projects/6988724078904b47b1c3feea3ec9fd32` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.620565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6988724078904b47b1c3feea3ec9fd32)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.621295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03684eeb-4e6f-4e61-a1a8-fc99080d75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.621989 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684eeb-4e6f-4e61-a1a8-fc99080d75c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.622249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684eeb-4e6f-4e61-a1a8-fc99080d75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.622637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.622840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684eeb-4e6f-4e61-a1a8-fc99080d75c2 admin admin] PATH_INFO: `/v3/projects/4e7d6cda9a2849af811b137b3d2598c5/users/c4f92845ce74435abf9e1e1acc280069/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.624607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:11.640062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03684eeb-4e6f-4e61-a1a8-fc99080d75c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7d6cda9a2849af811b137b3d2598c5, user_id=c4f92845ce74435abf9e1e1acc280069, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.642843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03684eeb-4e6f-4e61-a1a8-fc99080d75c2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.645315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:11.663846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1038/2076] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:11 2022] PUT /identity/v3/projects/4e7d6cda9a2849af811b137b3d2598c5/users/c4f92845ce74435abf9e1e1acc280069/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:11.665509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.665857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.666191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.699474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6988724078904b47b1c3feea3ec9fd32', 'request_id': 'req-59986510-d823-43cb-a0b1-479773e8ca53'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.704569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.706227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6988724078904b47b1c3feea3ec9fd32', 'request_id': 'req-59986510-d823-43cb-a0b1-479773e8ca53'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.706515 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.714203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6988724078904b47b1c3feea3ec9fd32', 'request_id': 'req-59986510-d823-43cb-a0b1-479773e8ca53'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.729867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] The token cache is being invalidate because project 6988724078904b47b1c3feea3ec9fd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:11.730256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.730915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:11.732593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1039/2077] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:11 2022] DELETE /identity/v3/projects/6988724078904b47b1c3feea3ec9fd32 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:11.733397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.734852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.779469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1039/2078] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.780107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.781472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.793477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594344b7-6672-4bbc-ac95-ba2acc98a13a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.798718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffdde4-a0c8-4033-853a-cde20be91570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.799754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffdde4-a0c8-4033-853a-cde20be91570 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.799754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffdde4-a0c8-4033-853a-cde20be91570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.799754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffdde4-a0c8-4033-853a-cde20be91570 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.800378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffdde4-a0c8-4033-853a-cde20be91570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.802280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffdde4-a0c8-4033-853a-cde20be91570 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.812730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59986510-d823-43cb-a0b1-479773e8ca53 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.817899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2481c0-63c3-463e-a0d2-e92cf52e874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.818519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2481c0-63c3-463e-a0d2-e92cf52e874f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.818830 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2481c0-63c3-463e-a0d2-e92cf52e874f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.819102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2481c0-63c3-463e-a0d2-e92cf52e874f admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.819741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2481c0-63c3-463e-a0d2-e92cf52e874f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.821837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2481c0-63c3-463e-a0d2-e92cf52e874f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.836089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1040/2079] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:11.837424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1cb2-9a29-42c5-9518-32cc19b7b716 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.837709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1cb2-9a29-42c5-9518-32cc19b7b716 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.837998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1cb2-9a29-42c5-9518-32cc19b7b716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.858015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1040/2080] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:11.858015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.858015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.858015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.867452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bacb1cb2-9a29-42c5-9518-32cc19b7b716 None None] MFA Rules not processed for user `c4f92845ce74435abf9e1e1acc280069`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.868749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bacb1cb2-9a29-42c5-9518-32cc19b7b716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.876706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.877892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.934791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1041/2081] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.936196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.936482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.936754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.940961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1041/2082] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.941634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.951264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc798d5-bf70-40d9-9d8d-e48b4e4987a0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.956932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.957846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.958119 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.958385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.959061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.960994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:11.965346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:11.966629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.978643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1042/2083] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:11.978643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.982969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:11.990135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10344b-8691-48f6-b1cd-4f3c9d4c3cee None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:11.990746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1042/2084] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:11.992307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:11.995383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d076667-aab4-47a8-9315-d89155b064d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:11.995988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:11.996181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d076667-aab4-47a8-9315-d89155b064d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:11.996524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d076667-aab4-47a8-9315-d89155b064d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:11.996860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d076667-aab4-47a8-9315-d89155b064d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:11.997636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d076667-aab4-47a8-9315-d89155b064d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:11.999720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d076667-aab4-47a8-9315-d89155b064d3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.012818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831665-36c3-4bf4-967a-82867d8d1c96 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.020349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.021324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.021853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.022513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.023145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.025455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.029680 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1043/2085] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/users => generated 298 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.031218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.031676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.032167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.055405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:12.056876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:12.066434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1044/2086] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:12.067813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.078521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75441b-4fe3-45b1-935f-3dfb840a5b57 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.084329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.084948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.085226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.085495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.086494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1043/2087] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.087675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.089215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:12.089605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.091372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.104030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1045/2088] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:12.104858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.117290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb0ab3-5621-4058-9f6b-cbc645f2d6d3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.135236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:12.167759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8bffc-314f-4ff8-93e5-6e8ca951616a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.173533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.174471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.174794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.175073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.175825 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.177690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.186058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.186799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.187139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.187472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.188382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.188860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1044/2089] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.189959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.190111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.200474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1046/2090] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.201131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.201532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcbfe6-da9f-4ad1-9a73-cb6e6f9da728 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.206367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.207059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.207640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.207942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.208603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:12.208900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.210765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.212300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c435-7716-42a7-8ac6-cdb12f86b58e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.216957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.217542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.217816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.218105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.218743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.220757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.223029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1045/2091] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:12.223867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.233783 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad608a-f003-4f50-b153-72d62166008c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.238906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.239491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.239737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.240007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.240634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.242516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.246414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1047/2092] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/users => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.246414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.254601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488451f2-ec07-4e07-92e4-bd01c646e400 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.259669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.260305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.260724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.260992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.261679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.263531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.271442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1046/2093] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.272379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.275138 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1048/2094] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.275887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.287570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ae2a-da37-4ebb-a694-cb762953a6af admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.347274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.347890 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.348198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.348466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.349092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.351074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.357896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaac30-b210-48f0-9321-b3e1d1a1c171 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.362778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.363442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.363718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.363997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] PATH_INFO: `/v3/projects/5dc009f3ac52438ba2a202b017fca2f3/users/8efd5166db3e471faf788f166e15c6af/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.378628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1049/2095] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.379690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc009f3ac52438ba2a202b017fca2f3, user_id=8efd5166db3e471faf788f166e15c6af, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.380036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.382540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.396673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1047/2096] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:12 2022] PUT /identity/v3/projects/5dc009f3ac52438ba2a202b017fca2f3/users/8efd5166db3e471faf788f166e15c6af/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:12.397658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.418877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:12.445371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30034edc-f74a-4d9c-a666-129b569c3fa1 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.458348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:12.463230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b168-7eaf-45d1-a199-594ceb88acff admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.468285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.468907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.469193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.469460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.470088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.472142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.497451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1048/2097] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.497451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.505352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.505506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7facf-39fa-4fc4-87a9-8b133fb64e34 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.505973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.506253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.506522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.507202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.508835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.510172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.510870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.511151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.511432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] PATH_INFO: `/v3/projects/2f39e7011a4f40caabbe4d8837406997/users/19045d22fadc4fa4b04b338d01e87407/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.518977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1050/2098] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.519597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.528844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f39e7011a4f40caabbe4d8837406997, user_id=19045d22fadc4fa4b04b338d01e87407, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.529037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29054b5-4d02-4ee5-bdce-7a66a630edfa admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.531650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.533757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.534365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.534605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.534941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.535555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.537547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.546106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1049/2099] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:12 2022] PUT /identity/v3/projects/2f39e7011a4f40caabbe4d8837406997/users/19045d22fadc4fa4b04b338d01e87407/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:12.555054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.574154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1051/2100] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.574154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.583209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9cba5-a119-452e-a2a1-a4617e19f711 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.613522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15365459-347a-495b-94dc-246bdde0d201 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.618419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.619055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.619333 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.619598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.620239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.621843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.631559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1050/2101] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.632485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.641766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e165-551f-4e26-b710-d6bbd7314fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.642393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e165-551f-4e26-b710-d6bbd7314fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.642671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e165-551f-4e26-b710-d6bbd7314fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.642979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e165-551f-4e26-b710-d6bbd7314fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.643629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0e165-551f-4e26-b710-d6bbd7314fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.644158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0105-1c8e-4a43-b541-b7a7323f5dad admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.645245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0e165-551f-4e26-b710-d6bbd7314fe8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.648833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.649463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.649741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.650012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] PATH_INFO: `/v3/projects/668d775048894e0d9025e44121cb2635/users/a41753a8176b439d881d51ecd3c87d5e/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.658773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1052/2102] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.658773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.658773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.658773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.666029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668d775048894e0d9025e44121cb2635, user_id=a41753a8176b439d881d51ecd3c87d5e, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.668674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.683317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1051/2103] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:12 2022] PUT /identity/v3/projects/668d775048894e0d9025e44121cb2635/users/a41753a8176b439d881d51ecd3c87d5e/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:12.684298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.687022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] MFA Rules not processed for user `19045d22fadc4fa4b04b338d01e87407`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:12.688238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:12.751237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:12.755027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9525547-0ae8-4764-a7a7-fbb2779854f9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.761873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.762678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.763129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.763542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.764323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.766352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.774153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1053/2104] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:12.775059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.781282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1052/2105] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.782399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.788256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346e618-4bdf-4492-9849-ffb9ad3dd9b4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.792404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c28b-f0ae-48ad-bfc6-b6cb8f8f5f81 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.793018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.793695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.793972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.794246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] PATH_INFO: `/v3/projects/5dc009f3ac52438ba2a202b017fca2f3/users/8efd5166db3e471faf788f166e15c6af/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.796326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc009f3ac52438ba2a202b017fca2f3, user_id=8efd5166db3e471faf788f166e15c6af, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.797955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.798767 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.799124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.799366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.799776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.800561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.802300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.811187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1054/2106] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:12 2022] PUT /identity/v3/projects/5dc009f3ac52438ba2a202b017fca2f3/users/8efd5166db3e471faf788f166e15c6af/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:12.812255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.817373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1053/2107] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.818291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.827266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:12.830878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79ac3-be29-45d7-8878-1da8eba6aae8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.888493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342366-5864-4759-97f4-bdb0cd5ea779 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.902708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.902894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.903003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.903003 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.903198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.903284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.903367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.903367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.903532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.903629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:12.903714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.903796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:12.919452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1055/2108] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:12.923641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.931016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1054/2109] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:12.932079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:12.934299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570c587-82f8-4b31-9252-dd8b885a31f9 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.995721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dd618-d8b2-414b-b26a-1881c83845e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:12.995929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f9ef-09ae-48e8-9b0c-5be30f0bd027 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:12.996377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd618-d8b2-414b-b26a-1881c83845e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.997286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd618-d8b2-414b-b26a-1881c83845e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.997548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd618-d8b2-414b-b26a-1881c83845e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.998203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dd618-d8b2-414b-b26a-1881c83845e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.000563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dd618-d8b2-414b-b26a-1881c83845e4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.001076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.002101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.002101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.002290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] PATH_INFO: `/v3/projects/f7ef738ed03248d8bb8ccd5a31c6b8d6/users/1828bb9e93e2485fa55e9f068773930c/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.014799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1056/2110] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:13.014799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.016346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.016720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.028197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ef738ed03248d8bb8ccd5a31c6b8d6, user_id=1828bb9e93e2485fa55e9f068773930c, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.031651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.049361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] MFA Rules not processed for user `8efd5166db3e471faf788f166e15c6af`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:13.050250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1055/2111] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:12 2022] PUT /identity/v3/projects/f7ef738ed03248d8bb8ccd5a31c6b8d6/users/1828bb9e93e2485fa55e9f068773930c/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:13.050823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.051673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.110666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:13.129705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fb326-b14d-4e1b-bcc7-c136e95093e8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.134908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.135778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.136018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.136315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] PATH_INFO: `/v3/projects/668d775048894e0d9025e44121cb2635/users/a41753a8176b439d881d51ecd3c87d5e/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.138609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668d775048894e0d9025e44121cb2635, user_id=a41753a8176b439d881d51ecd3c87d5e, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.141488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.156853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1056/2112] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:13 2022] PUT /identity/v3/projects/668d775048894e0d9025e44121cb2635/users/a41753a8176b439d881d51ecd3c87d5e/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:13.159634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.170875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1057/2113] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:13.171884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.205106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec982-60d3-4354-ad59-4430b2d53d87 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.244472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:13.276733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97c0b-203c-4de7-9b97-3f672fec5681 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.282377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0092906-29c5-4230-ba61-58882a7e250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.283097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092906-29c5-4230-ba61-58882a7e250b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.283372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092906-29c5-4230-ba61-58882a7e250b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.283713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092906-29c5-4230-ba61-58882a7e250b admin admin] PATH_INFO: `/v3/projects/7bf04c9fa0b14406a5e3eaab3828adce/users/237ac3a86ccc465b90553c44909f7dbd/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.284646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1e3a6-107d-44f2-ac3d-15d1acf0b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.285352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1e3a6-107d-44f2-ac3d-15d1acf0b8be admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.285634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1e3a6-107d-44f2-ac3d-15d1acf0b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.286006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1e3a6-107d-44f2-ac3d-15d1acf0b8be admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.286552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1e3a6-107d-44f2-ac3d-15d1acf0b8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.288573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1e3a6-107d-44f2-ac3d-15d1acf0b8be admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.302668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0092906-29c5-4230-ba61-58882a7e250b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf04c9fa0b14406a5e3eaab3828adce, user_id=237ac3a86ccc465b90553c44909f7dbd, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.306308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0092906-29c5-4230-ba61-58882a7e250b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.317211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1057/2114] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:13.318390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.318703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.319092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.326055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1058/2115] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:13 2022] PUT /identity/v3/projects/7bf04c9fa0b14406a5e3eaab3828adce/users/237ac3a86ccc465b90553c44909f7dbd/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:13.327206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.327585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.327950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.357177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] MFA Rules not processed for user `1828bb9e93e2485fa55e9f068773930c`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:13.357838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] MFA Rules not processed for user `a41753a8176b439d881d51ecd3c87d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:13.358641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.359348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.455950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1058/2116] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:13.456822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.458462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.458826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1059/2117] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:13.460137 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.543843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13281-fd01-41f3-80d1-458fc0469eb0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.544323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503c7c-66a3-4a03-8c1d-01c801268636 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.547671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.548358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.548639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.548900 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.549180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d2345-d6fc-42fd-97cc-3f3e19d47b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.550051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d2345-d6fc-42fd-97cc-3f3e19d47b92 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.550402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d2345-d6fc-42fd-97cc-3f3e19d47b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.550621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.550827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d2345-d6fc-42fd-97cc-3f3e19d47b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.551544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d2345-d6fc-42fd-97cc-3f3e19d47b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.553223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d2345-d6fc-42fd-97cc-3f3e19d47b92 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.564372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1060/2118] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:13.565715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.566004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.566279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.572023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:13.600943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] MFA Rules not processed for user `237ac3a86ccc465b90553c44909f7dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:13.602310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.618843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.620299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.622620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:13.632313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1059/2119] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:13.632749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.645217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781f67-cfd4-414a-8b99-1c83dfea40f3 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.651168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.652273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.652273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.652572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.653435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.655555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.690574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1060/2120] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:13.692652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.695492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.700176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1061/2121] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:13.700176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.709575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b852cbf-05cb-478b-9c9d-5c5503a53b10 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.779694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.780188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f2f0-1768-47f2-b70a-f336c9677592 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.780302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.780571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.780838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.781651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.784030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.785384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.786265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.786793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.787279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.800129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1062/2122] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:13.801067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.814237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302ad10-edcb-4739-b029-c9a939ec1bd0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.821935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.822543 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.822984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.823307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.823930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.826054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.855272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1063/2123] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:13.856381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.869023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8301-ea26-4200-9800-c43c3d4c4fec admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.876435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.877616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.878149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.878525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.878645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.879324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.880446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.881520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.902875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1061/2124] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:13.904062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.926574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1064/2125] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:13 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:13.926574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.939239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c798615-c52e-43cc-8813-f459b97a1fd8 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.026177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:14.047812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.048913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.049564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.050069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] PATH_INFO: `/v3/projects/c0765a5674c649eb8a124396361cadbc/users/cebd024378cb4eed89c004af82cb91cb/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.081864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0765a5674c649eb8a124396361cadbc, user_id=cebd024378cb4eed89c004af82cb91cb, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.086901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.123216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1062/2126] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:13 2022] PUT /identity/v3/projects/c0765a5674c649eb8a124396361cadbc/users/cebd024378cb4eed89c004af82cb91cb/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:14.125894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.134791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399bbb-59b4-4d5e-97d1-cc063f2fc08a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.199069 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:14.279623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949588e-e8a6-4b4d-9d1a-2ab076e102f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.281027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949588e-e8a6-4b4d-9d1a-2ab076e102f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.281525 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949588e-e8a6-4b4d-9d1a-2ab076e102f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.281975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949588e-e8a6-4b4d-9d1a-2ab076e102f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.282832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949588e-e8a6-4b4d-9d1a-2ab076e102f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.285710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949588e-e8a6-4b4d-9d1a-2ab076e102f9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.295795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdacf95-5a67-4e54-98e8-8b7ca7614b62 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.301461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1065/2127] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:14.303524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.303987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.304440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.311460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.312107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.312387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.312685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.313374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.315382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.347155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] MFA Rules not processed for user `cebd024378cb4eed89c004af82cb91cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:14.348856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:14.368913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1063/2128] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:14 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:14.370076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.454349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1066/2129] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:14.455564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.467143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d3609-163f-4473-8e85-01ec65e522b3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.471362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.471908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.472088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.472364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.473819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ffae0-e333-4ce2-9ccf-e07e5ac05a48 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.480496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.480814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.481082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.481346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.481984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.483708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.499095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1067/2130] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:14.500477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.523752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f76c3-1abf-48cb-8e25-b42a62d9edda admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.529559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.530186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.530464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.530769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.531503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.535206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.546090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1068/2131] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:14.549947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.563046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32fa6-e874-46aa-b2d6-1fd772edbb63 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.566573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.568149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.568999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.570204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.570313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.570669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.571486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.573565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.587561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1064/2132] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:14.588411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.613151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56822b8-259c-4bc5-b507-5aa618b589df service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.627217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.627942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.628244 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.628484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] PATH_INFO: `/v3/projects/aa295671c2624632a82b664bd65f78b8/users/dd963fed2f0048c791b0d180f9bba48b/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.645074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1069/2133] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:14 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:14.646666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.653869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:14.666086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa295671c2624632a82b664bd65f78b8, user_id=dd963fed2f0048c791b0d180f9bba48b, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.668956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.692297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1065/2134] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:14 2022] PUT /identity/v3/projects/aa295671c2624632a82b664bd65f78b8/users/dd963fed2f0048c791b0d180f9bba48b/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:14.693134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:14.775775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90a0c-0ce3-4a1a-ba32-3581b82ebff3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.801415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:14.901397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668faa6-7328-4285-9ca3-366f9bddf097 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:14.917259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.919274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.919274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.919274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.919274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.921361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:14.965977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30010780-49f6-442e-912c-07f1aecb5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:14.966706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30010780-49f6-442e-912c-07f1aecb5e6c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:14.968752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30010780-49f6-442e-912c-07f1aecb5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:14.969187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30010780-49f6-442e-912c-07f1aecb5e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:14.970897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30010780-49f6-442e-912c-07f1aecb5e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:14.976628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30010780-49f6-442e-912c-07f1aecb5e6c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.002011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1070/2135] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:15.003822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.004286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.004731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.009736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1066/2136] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:14 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:15.012429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.034227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc3a3-4d51-4479-aac8-c4cd48b7e4a8 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.039111 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.039787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.040068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.040988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] PATH_INFO: `/v3/projects/f23b0b9fa9ce4c4d9927d7093d11de33/users/7dc08b684921446c82d2f9f0d2cfdd02/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.044209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] MFA Rules not processed for user `dd963fed2f0048c791b0d180f9bba48b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:15.047053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.063491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23b0b9fa9ce4c4d9927d7093d11de33, user_id=7dc08b684921446c82d2f9f0d2cfdd02, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.066308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.100533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1067/2137] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:15 2022] PUT /identity/v3/projects/f23b0b9fa9ce4c4d9927d7093d11de33/users/7dc08b684921446c82d2f9f0d2cfdd02/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:15.100533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.142202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1071/2138] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:15.144151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.160229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df0cc-5596-4ccc-9546-4f28b5ee5e39 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.184956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6a59-8712-447a-bfe9-defda6b1d85d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.194104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd2f6-bb08-4562-be5a-59e6f49d14bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.194447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd2f6-bb08-4562-be5a-59e6f49d14bc admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.194638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd2f6-bb08-4562-be5a-59e6f49d14bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.194905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd2f6-bb08-4562-be5a-59e6f49d14bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.195638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffd2f6-bb08-4562-be5a-59e6f49d14bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.197278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffd2f6-bb08-4562-be5a-59e6f49d14bc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.212671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1068/2139] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:15.218318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.218604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.219058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.272430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] MFA Rules not processed for user `7dc08b684921446c82d2f9f0d2cfdd02`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:15.274638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.275814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.276675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.276953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.277225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] PATH_INFO: `/v3/users/c4f92845ce74435abf9e1e1acc280069` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.278705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f92845ce74435abf9e1e1acc280069)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.281020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.321383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:15.349470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:15.356137 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f92845ce74435abf9e1e1acc280069'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:15.357471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f92845ce74435abf9e1e1acc280069'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:15.366197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1069/2140] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:15.366197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.368619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f92845ce74435abf9e1e1acc280069'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:15.379369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d6f1-dd63-433d-b7cd-75386f938da2 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.401064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f92845ce74435abf9e1e1acc280069'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:15.402173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.402278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f92845ce74435abf9e1e1acc280069'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:15.402355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.402355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.402355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.402355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.402355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.410252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1072/2141] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:15 2022] DELETE /identity/v3/users/c4f92845ce74435abf9e1e1acc280069 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:15.410595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.412511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.432632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1070/2142] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:15.433541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.436444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.492826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f46072-81b9-478f-9f85-41b9c61bdbb2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.545772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c40e2-ff9d-42dc-906a-75644533292d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.553343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b387-751b-429e-b819-bf1487402cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.554030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b387-751b-429e-b819-bf1487402cbc admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.554296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b387-751b-429e-b819-bf1487402cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.554570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b387-751b-429e-b819-bf1487402cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.555492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577b387-751b-429e-b819-bf1487402cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.557817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577b387-751b-429e-b819-bf1487402cbc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.575594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.576341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.576692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.577142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] PATH_INFO: `/v3/projects/61397702e0564ddaaffb8797814b92ab/users/db5fe19eaf80423bbd036a7d87da10d4/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.596310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1071/2143] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:15.597948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b876801-d196-4727-b57f-999e587be709 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.598440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b876801-d196-4727-b57f-999e587be709 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.599063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b876801-d196-4727-b57f-999e587be709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.601800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61397702e0564ddaaffb8797814b92ab, user_id=db5fe19eaf80423bbd036a7d87da10d4, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.605892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.622590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8b876801-d196-4727-b57f-999e587be709 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:15.623866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8b876801-d196-4727-b57f-999e587be709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.625483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1073/2144] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:15 2022] PUT /identity/v3/projects/61397702e0564ddaaffb8797814b92ab/users/db5fe19eaf80423bbd036a7d87da10d4/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:15.626403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.628622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.687441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:15.696223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1072/2145] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:15.697200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b876801-d196-4727-b57f-999e587be709 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.702665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8b876801-d196-4727-b57f-999e587be709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.720423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24bb8-ccb6-46c3-8899-26064a97a033 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.725797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.726493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.726876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.727212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.728091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.730117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.756968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1074/2146] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:15.756968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.766665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:15.767008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc237838-5457-4585-ac9a-56b402fd29ae admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.773202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.774341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.774631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.775073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.776374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.778501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.780047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b876801-d196-4727-b57f-999e587be709 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.783743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.784585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.784866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.785140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.787314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.801686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1075/2147] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:15 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:15.802356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.812131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97f45-87f9-4dd7-879c-ca714f1a86ac admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.817335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.818444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.818444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.818847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.819340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.821591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.836236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1076/2148] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:15.836236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.836236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:15.870597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.873399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.883587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1073/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:15.884427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.895948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94eff-e44c-473f-a20f-ebabc55a1bb2 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.899473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34867c-a294-439b-9786-f93728986f64 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.902247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.903169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.903450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.903784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.903924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.904539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.904903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.905409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.905813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.906136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.917812 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.918021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1074/2150] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:15.921599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.922352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.933353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492977c-21b0-4eb6-b3b1-3eab2e8263e1 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.935435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1077/2151] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:15.936556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.949979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c63f4-007d-4a6f-8d00-9a5c4b2c0945 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:15.955948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.956763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.957050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.957688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.957976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:15.958336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.958667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:15.958993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:15.959274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] PATH_INFO: `/v3/projects/61397702e0564ddaaffb8797814b92ab/users/db5fe19eaf80423bbd036a7d87da10d4/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:15.960310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.974232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61397702e0564ddaaffb8797814b92ab, user_id=db5fe19eaf80423bbd036a7d87da10d4, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:15.982217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:15.984731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1075/2152] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:15.985651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:15.998308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9d341-3383-42b2-968d-7e82d4ae63a1 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.011234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1078/2153] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:15 2022] PUT /identity/v3/projects/61397702e0564ddaaffb8797814b92ab/users/db5fe19eaf80423bbd036a7d87da10d4/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:16.012488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.087001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0af58-0c83-45fe-af4b-57426f176e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.087592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0af58-0c83-45fe-af4b-57426f176e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.087875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0af58-0c83-45fe-af4b-57426f176e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.088742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0af58-0c83-45fe-af4b-57426f176e2b admin admin] PATH_INFO: `/v3/projects/dc2b9064b66943588279fb8a5bf1ea5d/users/62b3cfc90abb47189c1a34721f68214f/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.122788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0af58-0c83-45fe-af4b-57426f176e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2b9064b66943588279fb8a5bf1ea5d, user_id=62b3cfc90abb47189c1a34721f68214f, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.125969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0af58-0c83-45fe-af4b-57426f176e2b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.141537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b838e-2750-42be-81f9-dab956ec3c50 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.152561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1076/2154] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:15 2022] PUT /identity/v3/projects/dc2b9064b66943588279fb8a5bf1ea5d/users/62b3cfc90abb47189c1a34721f68214f/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:16.152561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.152561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.152561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.198058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] MFA Rules not processed for user `db5fe19eaf80423bbd036a7d87da10d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:16.199433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:16.214634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:16.237867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.238733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.240881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.241250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] PATH_INFO: `/v3/projects/948ee46871384cfb9bfb2807017a22c6/users/0d5cfe651309457f83f23ba22ee438a5/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.300562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:16.301003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948ee46871384cfb9bfb2807017a22c6, user_id=0d5cfe651309457f83f23ba22ee438a5, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.305631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.341927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1079/2155] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:16 2022] PUT /identity/v3/projects/948ee46871384cfb9bfb2807017a22c6/users/0d5cfe651309457f83f23ba22ee438a5/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:16.342966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.353807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1077/2156] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:16.355467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.368929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde22c6f-9e8d-484a-b7d2-c1c2a1e0caa0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.508131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.508688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.509033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.509304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.510027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.511319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de887e04-bd29-4db0-828a-1f6426311104 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.511805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.517639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.518498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.519055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.519862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.519862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.521694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.541953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1078/2157] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:16.544990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.549833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:16.551151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1080/2158] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:16.559047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.592249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4304ee-c445-4b38-bf11-e160083a86bb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.606293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.607277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.607579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.609018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] PATH_INFO: `/v3/projects/948ee46871384cfb9bfb2807017a22c6/users/0d5cfe651309457f83f23ba22ee438a5/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.616252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] RBAC: Authorizing `identity:create_grant(project_id=948ee46871384cfb9bfb2807017a22c6, user_id=0d5cfe651309457f83f23ba22ee438a5, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.620912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.654018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1081/2159] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:16 2022] PUT /identity/v3/projects/948ee46871384cfb9bfb2807017a22c6/users/0d5cfe651309457f83f23ba22ee438a5/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:16.654018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.687107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed87f2-e4a3-4d0e-b870-f888fcae1d17 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.755211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1477bf-e60f-4b57-8e27-8d6bbfcf471b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.760140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.760824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.761117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.761385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] PATH_INFO: `/v3/projects/dc2b9064b66943588279fb8a5bf1ea5d/users/62b3cfc90abb47189c1a34721f68214f/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.763330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2b9064b66943588279fb8a5bf1ea5d, user_id=62b3cfc90abb47189c1a34721f68214f, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.766475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.767647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306be25-f6cb-4640-9cfc-85430794d384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.768549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306be25-f6cb-4640-9cfc-85430794d384 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.768828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306be25-f6cb-4640-9cfc-85430794d384 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.769096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306be25-f6cb-4640-9cfc-85430794d384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.778463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1082/2160] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:16 2022] PUT /identity/v3/projects/dc2b9064b66943588279fb8a5bf1ea5d/users/62b3cfc90abb47189c1a34721f68214f/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:16.779441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:16.781093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:16.837907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:16.839836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:16.853639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306be25-f6cb-4640-9cfc-85430794d384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.855350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306be25-f6cb-4640-9cfc-85430794d384 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.860894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea5d4-8b6d-40f8-8b84-8f318e3ea472 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:16.866092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:16.866778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.867081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.867414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] PATH_INFO: `/v3/projects/4e7d6cda9a2849af811b137b3d2598c5` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.868574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7d6cda9a2849af811b137b3d2598c5)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:16.870721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:16.876277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1079/2161] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:16.877755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.878042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.878322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:16.917080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] MFA Rules not processed for user `0d5cfe651309457f83f23ba22ee438a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:16.918281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:16.930142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7d6cda9a2849af811b137b3d2598c5', 'request_id': 'req-bb3f3d10-07a7-4083-80d3-ce88acc25d45'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:16.939755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7d6cda9a2849af811b137b3d2598c5', 'request_id': 'req-bb3f3d10-07a7-4083-80d3-ce88acc25d45'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:16.953018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7d6cda9a2849af811b137b3d2598c5', 'request_id': 'req-bb3f3d10-07a7-4083-80d3-ce88acc25d45'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:16.971617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] The token cache is being invalidate because project 4e7d6cda9a2849af811b137b3d2598c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:16.972119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:16.972770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-bb3f3d10-07a7-4083-80d3-ce88acc25d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:16.974704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1083/2162] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:16 2022] DELETE /identity/v3/projects/4e7d6cda9a2849af811b137b3d2598c5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:16.976255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:16.976590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:16.976982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:17.009612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1080/2163] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:17.009612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:17.009612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.019836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] MFA Rules not processed for user `62b3cfc90abb47189c1a34721f68214f`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:17.021253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.075935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20d6c-f560-405f-80c7-0529b5605e44 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:17.086294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:17.086294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:17.086294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:17.086294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:17.086855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.109479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1084/2164] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:17.111444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:17.112742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.152101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:17.153563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:17.165076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1081/2165] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:17.166033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:17.167500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.180932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ab6b-b81f-4879-9b56-e9d4829615f1 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:17.184968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:17.185585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:17.185863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:17.186141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:17.196005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:17.197441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:17.198045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90183649-e47d-4a22-9fbc-c42d4c525624 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:17.205447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:17.206262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:17.206634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:17.207045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] PATH_INFO: `/v3/users/a41753a8176b439d881d51ecd3c87d5e` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:17.208674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1082/2166] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:17.208810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41753a8176b439d881d51ecd3c87d5e)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:17.211025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:17.213883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:17.263149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:17.274523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a9a9-f3f3-4eb2-bc76-f877d47018c7 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:17.279355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:17.279761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:17.280175 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:17.280459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:17.282919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.289600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41753a8176b439d881d51ecd3c87d5e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:17.290304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:17.290440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41753a8176b439d881d51ecd3c87d5e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:17.300536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41753a8176b439d881d51ecd3c87d5e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:17.324809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41753a8176b439d881d51ecd3c87d5e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:17.327317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41753a8176b439d881d51ecd3c87d5e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:17.349270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1085/2167] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:17 2022] DELETE /identity/v3/users/a41753a8176b439d881d51ecd3c87d5e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:17.388078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:17.389935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:17.411135 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1083/2168] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:17.422384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:17.425241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.535899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f647f9-f126-4bc5-95af-d461a0168019 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:17.540861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:17.541477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:17.541762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:17.543049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:17.545648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:17.633406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:17.635199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:17.651124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1086/2169] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:18.135509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:18.145248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6070a-66b4-4ac7-a979-49ef1e21701b service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:18.152400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:18.153574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:18.153993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:18.154402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:18.157690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:18.262947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:18.262947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:18.269843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:18.275116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c65082-a5d7-4f2b-93d2-e4b39c11bace service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:18.302461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1084/2170] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:18.376791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:18.434716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c4e8-2279-4c01-8f36-526911b45cde service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:18.471608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:18.472971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:18.473290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:18.473560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] PATH_INFO: `/v3/projects/668d775048894e0d9025e44121cb2635` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:18.475485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=668d775048894e0d9025e44121cb2635)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:18.477785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:18.604482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668d775048894e0d9025e44121cb2635', 'request_id': 'req-6604f700-7711-4f39-aab0-892ce78346bf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:18.612467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668d775048894e0d9025e44121cb2635', 'request_id': 'req-6604f700-7711-4f39-aab0-892ce78346bf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:18.626123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668d775048894e0d9025e44121cb2635', 'request_id': 'req-6604f700-7711-4f39-aab0-892ce78346bf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:18.650056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] The token cache is being invalidate because project 668d775048894e0d9025e44121cb2635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:18.651414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:18.654638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6604f700-7711-4f39-aab0-892ce78346bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:18.656780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1087/2171] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:18 2022] DELETE /identity/v3/projects/668d775048894e0d9025e44121cb2635 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:18.662617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:18.663247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:18.663247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:18.694193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:18.697209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:18.796417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1085/2172] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:18.805014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:18.805724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:18.806050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:18.846670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:18.848717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:18.860855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1088/2173] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:18.865413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:18.881716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64acfd9-53b8-49c4-92f4-890b06407f34 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:18.892183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:18.892818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:18.893098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:18.893368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:18.895272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:18.895573 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:18.903547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:18.943846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1086/2174] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:18.948484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:18.966876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574441-bdb3-440d-8c52-450f0d29c823 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:18.994623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:18.994623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:18.994959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:18.995051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:18.995877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:18.998499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.038728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1089/2175] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:18 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:19.042730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.072424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39b69b-cd27-4c41-a9c6-c166f45f8194 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.110568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:19.143517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.144515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.144922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.145258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.145951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.148010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.172018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1087/2176] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:19 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:19.176770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.189279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b94a-9138-465d-a4d0-66cce80a3a7b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.195287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.196264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.196574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.196865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.197546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.199340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.211949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1090/2177] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:19.216219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.229028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07203b-a251-4c72-a9f4-3c596abe32c3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.235235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.235877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.236170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.236576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.237387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.239313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.250494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1088/2178] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:19.255399 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.259548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.261602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:19.265672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b697-12bd-4718-98df-bf2f70752186 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.271107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57a61b-f17a-4fcd-8bb7-6764a5bdcbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.272060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a61b-f17a-4fcd-8bb7-6764a5bdcbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.272810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a61b-f17a-4fcd-8bb7-6764a5bdcbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.273093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a61b-f17a-4fcd-8bb7-6764a5bdcbf5 admin admin] PATH_INFO: `/v3/projects/6c1c775d506b45bcbff49a2e6b9b3001/users/94d429a932e64728ae7c4cbb47db9aee/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.288485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57a61b-f17a-4fcd-8bb7-6764a5bdcbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1c775d506b45bcbff49a2e6b9b3001, user_id=94d429a932e64728ae7c4cbb47db9aee, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.292818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57a61b-f17a-4fcd-8bb7-6764a5bdcbf5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.307214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1091/2179] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:19 2022] PUT /identity/v3/projects/6c1c775d506b45bcbff49a2e6b9b3001/users/94d429a932e64728ae7c4cbb47db9aee/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:19.318706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.319014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.319305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.325807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6f325-c48a-4c2a-83f3-a2a883bc3467 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.348633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] MFA Rules not processed for user `94d429a932e64728ae7c4cbb47db9aee`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:19.349957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:19.379879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.381076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.381627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.382148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.385093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:19.423019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:19.449548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1092/2180] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:19.453702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.455899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.457760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.467742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1089/2181] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:19.525944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f00ad-c57f-4fad-a196-306021c3742b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.530896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.531563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.531845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.532111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.532747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.534807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.570880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1093/2182] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:19 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:49:19.575762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.587737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2693e0b-0d9a-461b-90fd-5ec7d402ea99 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.615624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:19.673532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.674193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.674418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.674717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.675362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.677337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.750957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1090/2183] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:19 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:49:19.753329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.767923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa70de-b26b-4445-8145-8a47f7e1024e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.780485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.781082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.781435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.781785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.783492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.785470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.801726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1094/2184] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:19.805924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.817373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036249ce-19fa-4e0c-a046-52fddaa0e906 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.827460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.828582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.828582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.828858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] PATH_INFO: `/v3/projects/f45583cffcae4e23a4a4ec585bdf0ffc/users/51bf82ac45fd49a6a52c2e9a04fcc9cc/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.846472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45583cffcae4e23a4a4ec585bdf0ffc, user_id=51bf82ac45fd49a6a52c2e9a04fcc9cc, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.849331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.870117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1091/2185] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:19 2022] PUT /identity/v3/projects/f45583cffcae4e23a4a4ec585bdf0ffc/users/51bf82ac45fd49a6a52c2e9a04fcc9cc/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:19.870258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:19.896401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799e9b-324a-4987-abf2-cb1f4e069d2b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:19.967870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20888bfe-4f0d-4c21-aad1-631509a8288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:19.968509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20888bfe-4f0d-4c21-aad1-631509a8288c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:19.968848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20888bfe-4f0d-4c21-aad1-631509a8288c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:19.969247 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20888bfe-4f0d-4c21-aad1-631509a8288c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:19.969978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20888bfe-4f0d-4c21-aad1-631509a8288c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:19.971808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20888bfe-4f0d-4c21-aad1-631509a8288c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:19.985163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1095/2186] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:19.988546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:20.002969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe1635-aea7-416f-a235-8c8ff3fb4557 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:20.012598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:20.014191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:20.014473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:20.014810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] PATH_INFO: `/v3/projects/f45583cffcae4e23a4a4ec585bdf0ffc/users/51bf82ac45fd49a6a52c2e9a04fcc9cc/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:20.019567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45583cffcae4e23a4a4ec585bdf0ffc, user_id=51bf82ac45fd49a6a52c2e9a04fcc9cc, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:20.023066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:20.047525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1092/2187] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:19 2022] PUT /identity/v3/projects/f45583cffcae4e23a4a4ec585bdf0ffc/users/51bf82ac45fd49a6a52c2e9a04fcc9cc/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:20.049334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:20.057872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:20.057872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:20.102360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] MFA Rules not processed for user `51bf82ac45fd49a6a52c2e9a04fcc9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:20.104395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:20.189692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:20.216209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1096/2188] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:20.286139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:20.384970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28f105-42fd-409c-8fcc-92bdb0019020 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:20.388808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:20.389422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:20.389700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:20.389970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:20.449584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:20.451212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:20.467990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:20.469619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:20.471352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb920-771b-4792-9b6c-779e73abfd7e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:20.474980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:20.475524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:20.475794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:20.476062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:20.477807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:20.481036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1093/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:20.549134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:20.551292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ddf36-d0c0-4b04-8fa7-e955a97c36f5 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:20.569384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1097/2190] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:21.020083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:21.021544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:21.053533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:21.089991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a13fc-1230-4fea-b38f-8fef45099e39 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:21.094855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:21.095494 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:21.095778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:21.096048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] PATH_INFO: `/v3/users/237ac3a86ccc465b90553c44909f7dbd` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:21.097188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237ac3a86ccc465b90553c44909f7dbd)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:21.099233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:21.146481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237ac3a86ccc465b90553c44909f7dbd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.147160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237ac3a86ccc465b90553c44909f7dbd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.154029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237ac3a86ccc465b90553c44909f7dbd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.166549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237ac3a86ccc465b90553c44909f7dbd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.167304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237ac3a86ccc465b90553c44909f7dbd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.182161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1094/2191] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:21 2022] DELETE /identity/v3/users/237ac3a86ccc465b90553c44909f7dbd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:21.187426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:21.187980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:21.188157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:21.208217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:21.209536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:21.271788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1098/2192] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:21.281473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:21.282920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:21.347201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab14d3d-3520-4910-92ca-a62544a50e28 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:21.350948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:21.351655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:21.351931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:21.352233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:21.362370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:21.363871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:21.376171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1095/2193] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:21.674994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:21.676755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:21.693577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96f00-3fab-43c2-884c-1eb7759f1a71 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:21.699566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:21.700580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:21.701042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:21.701510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] PATH_INFO: `/v3/projects/7bf04c9fa0b14406a5e3eaab3828adce` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:21.706996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf04c9fa0b14406a5e3eaab3828adce)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:21.718204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:21.785489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf04c9fa0b14406a5e3eaab3828adce', 'request_id': 'req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.799468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf04c9fa0b14406a5e3eaab3828adce', 'request_id': 'req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.810624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf04c9fa0b14406a5e3eaab3828adce', 'request_id': 'req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.823674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] The token cache is being invalidate because project 7bf04c9fa0b14406a5e3eaab3828adce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:21.824082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.824926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.826931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1099/2194] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:21 2022] DELETE /identity/v3/projects/7bf04c9fa0b14406a5e3eaab3828adce => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:21.833610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:21.844808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e18085-560e-4281-ba14-80366db9466e service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:21.909412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:21.925345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:21.926195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:21.926549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:21.926855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] PATH_INFO: `/v3/users/7dc08b684921446c82d2f9f0d2cfdd02` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:21.928006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc08b684921446c82d2f9f0d2cfdd02)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:21.929992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:21.993015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc08b684921446c82d2f9f0d2cfdd02'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:21.993707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc08b684921446c82d2f9f0d2cfdd02'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.013854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc08b684921446c82d2f9f0d2cfdd02'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.034498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc08b684921446c82d2f9f0d2cfdd02'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.035552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cfe49ea-c6db-4779-9647-7f8d507211aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc08b684921446c82d2f9f0d2cfdd02'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.052637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1096/2195] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:21 2022] DELETE /identity/v3/users/7dc08b684921446c82d2f9f0d2cfdd02 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:22.136776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:22.138233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:22.153519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:22.175722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b2ed-0ac6-4e29-86f8-a56d75bfb080 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:22.333588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:22.337384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:22.338390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:22.339470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] PATH_INFO: `/v3/users/8fbd61416abf447585df33946b601a55` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:22.343027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbd61416abf447585df33946b601a55)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:22.348233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:22.422603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbd61416abf447585df33946b601a55'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.423444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbd61416abf447585df33946b601a55'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.436048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbd61416abf447585df33946b601a55'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.460542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbd61416abf447585df33946b601a55'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.462221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbd61416abf447585df33946b601a55'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.491745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1100/2196] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:22 2022] DELETE /identity/v3/users/8fbd61416abf447585df33946b601a55 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:22.499412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:22.499985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:22.500307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:22.536934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:22.538437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:22.577134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:22.578766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:22.648450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1097/2197] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:22.659326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:22.661471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:22.689343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19227da-de29-4862-857a-176a17fb966e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:22.695025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:22.695858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:22.696326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:22.696766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] PATH_INFO: `/v3/projects/f23b0b9fa9ce4c4d9927d7093d11de33` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:22.698177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23b0b9fa9ce4c4d9927d7093d11de33)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:22.700150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:22.737462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af803e00-5bb8-418f-b353-eadf5e75ad57 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:22.741474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:22.742104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:22.742382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:22.742655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:22.753414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:22.755038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:22.766450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1098/2198] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:22.772905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:22.799833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23b0b9fa9ce4c4d9927d7093d11de33', 'request_id': 'req-539405d3-1cb5-4471-a0fc-1da7db170e96'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.805824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23b0b9fa9ce4c4d9927d7093d11de33', 'request_id': 'req-539405d3-1cb5-4471-a0fc-1da7db170e96'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.821630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23b0b9fa9ce4c4d9927d7093d11de33', 'request_id': 'req-539405d3-1cb5-4471-a0fc-1da7db170e96'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.844037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] The token cache is being invalidate because project f23b0b9fa9ce4c4d9927d7093d11de33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:22.844867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.845910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:22.850638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1101/2199] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:22 2022] DELETE /identity/v3/projects/f23b0b9fa9ce4c4d9927d7093d11de33 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:22.851703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:22.864454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9bea5-52dd-45ab-83f7-aa115c845617 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:22.876359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:22.962819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:22.963522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:22.963805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:22.964078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] PATH_INFO: `/v3/users/0d5cfe651309457f83f23ba22ee438a5` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:22.966009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5cfe651309457f83f23ba22ee438a5)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:22.968476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:22.987068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:22.988829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:23.047808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5cfe651309457f83f23ba22ee438a5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.048709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5cfe651309457f83f23ba22ee438a5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.058648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5cfe651309457f83f23ba22ee438a5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.072387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539405d3-1cb5-4471-a0fc-1da7db170e96 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:23.079797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:23.080089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:23.080486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:23.080860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:23.085073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:23.092345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5cfe651309457f83f23ba22ee438a5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.093080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5cfe651309457f83f23ba22ee438a5'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.111792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1099/2200] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:22 2022] DELETE /identity/v3/users/0d5cfe651309457f83f23ba22ee438a5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:23.118540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:23.120165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:23.197840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:23.199591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:23.212528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1102/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:23.214983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05328d-37fa-4bdd-a959-c6ac41f808d4 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:23.220071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:23.220718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:23.220991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:23.221258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] PATH_INFO: `/v3/projects/3079868613284566a74a7ade64b8c5b6` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:23.222435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3079868613284566a74a7ade64b8c5b6)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:23.224419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:23.276397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:23.298625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3079868613284566a74a7ade64b8c5b6', 'request_id': 'req-db33460a-397d-462e-a8d1-bc4cd1852d61'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.305503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3079868613284566a74a7ade64b8c5b6', 'request_id': 'req-db33460a-397d-462e-a8d1-bc4cd1852d61'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.313840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3079868613284566a74a7ade64b8c5b6', 'request_id': 'req-db33460a-397d-462e-a8d1-bc4cd1852d61'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.336166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] The token cache is being invalidate because project 3079868613284566a74a7ade64b8c5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:23.336469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.339722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.343669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1100/2202] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:23 2022] DELETE /identity/v3/projects/3079868613284566a74a7ade64b8c5b6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:23.348318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:23.350302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:23.378198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdedf-26f6-4fb8-8732-fdff30b76c7b service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:23.520724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:23.521448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:23.521715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:23.522300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] PATH_INFO: `/v3/users/fefd67a0349f403dbc67c9d0d5e9497e` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:23.527100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefd67a0349f403dbc67c9d0d5e9497e)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:23.528993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:23.557610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:23.701441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefd67a0349f403dbc67c9d0d5e9497e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.703468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefd67a0349f403dbc67c9d0d5e9497e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.746439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefd67a0349f403dbc67c9d0d5e9497e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.779033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefd67a0349f403dbc67c9d0d5e9497e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.779873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dbe5ecd3-3ed8-4f40-9b2a-2cc87ec56a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefd67a0349f403dbc67c9d0d5e9497e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:23.810562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1103/2203] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:23 2022] DELETE /identity/v3/users/fefd67a0349f403dbc67c9d0d5e9497e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:23.847010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:23.848725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:23.869194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33460a-397d-462e-a8d1-bc4cd1852d61 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.036874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.037584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.037917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.038230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] PATH_INFO: `/v3/projects/948ee46871384cfb9bfb2807017a22c6` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.040391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=948ee46871384cfb9bfb2807017a22c6)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.045524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.124057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948ee46871384cfb9bfb2807017a22c6', 'request_id': 'req-c1481f8d-55ae-483b-ab2c-b172f7279f2c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.132507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948ee46871384cfb9bfb2807017a22c6', 'request_id': 'req-c1481f8d-55ae-483b-ab2c-b172f7279f2c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.141247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948ee46871384cfb9bfb2807017a22c6', 'request_id': 'req-c1481f8d-55ae-483b-ab2c-b172f7279f2c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.177794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] The token cache is being invalidate because project 948ee46871384cfb9bfb2807017a22c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:24.178743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.180275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c1481f8d-55ae-483b-ab2c-b172f7279f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.183529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1101/2204] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:23 2022] DELETE /identity/v3/projects/948ee46871384cfb9bfb2807017a22c6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:24.189497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.189785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.190059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.218286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:24.220114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:24.317725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1104/2205] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:24.325847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.326134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.326411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.368181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:24.371521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:24.391583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1102/2206] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:24.394871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.407172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e709ff-76fc-41ab-8d21-e288547e0c15 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.424511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.425157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.425436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.425707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.426385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:24.426796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.429114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.452656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1105/2207] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:24.458163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.469027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1c4d-e77b-485c-85e6-2dbe3ba3d42d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.475679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.476482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.476800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.477088 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.477734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.479840 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.514385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1103/2208] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:24 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:24.515603 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.526185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5501-8a81-4e57-97af-144094f4c559 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.558959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.560932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:24.593549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.594527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.594643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:24.594883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.595331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.597004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.597865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.642370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1106/2209] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:24 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:49:24.646279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.651742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601372d5-a1fe-40c7-b7f5-66b5127695c2 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.657721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.658096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:24.658548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.658948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.659290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] PATH_INFO: `/v3/projects/1124bd95da524168bea2b0b52a07783e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.660598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1124bd95da524168bea2b0b52a07783e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.662841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.663936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c827-65dd-4df3-95d8-51dfda00a358 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.670568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.671667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.671984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.672327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.673981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.675901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.695892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1107/2210] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:24.700174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.713929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4997-463e-4cb3-b8fe-5febc1e18489 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.732117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1124bd95da524168bea2b0b52a07783e', 'request_id': 'req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.744067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1124bd95da524168bea2b0b52a07783e', 'request_id': 'req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.755219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1124bd95da524168bea2b0b52a07783e', 'request_id': 'req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.774994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] The token cache is being invalidate because project 1124bd95da524168bea2b0b52a07783e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:24.775326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.775985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:24.781862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1104/2211] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:24 2022] DELETE /identity/v3/projects/1124bd95da524168bea2b0b52a07783e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:24.782843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.784456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:24.807213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.807972 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.808869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.809156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.809828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.811521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.823676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1108/2212] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:24.828358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:24.830187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:24.846869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a0be-5328-4a33-a819-1f58aa16f8bb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.852397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba12ac-8179-4171-9e8b-cd01f8b82069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.852994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba12ac-8179-4171-9e8b-cd01f8b82069 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.853272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba12ac-8179-4171-9e8b-cd01f8b82069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.853551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba12ac-8179-4171-9e8b-cd01f8b82069 admin admin] PATH_INFO: `/v3/projects/942276ff43124ad3b2e4fad66a4f1a80/users/fda1bc91c37e48609db643b99990f9aa/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.876016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba12ac-8179-4171-9e8b-cd01f8b82069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942276ff43124ad3b2e4fad66a4f1a80, user_id=fda1bc91c37e48609db643b99990f9aa, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.879963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba12ac-8179-4171-9e8b-cd01f8b82069 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.891948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e404d3f-d0a8-4bda-b2f6-46d359c24d39 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:24.912480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1109/2213] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:24 2022] PUT /identity/v3/projects/942276ff43124ad3b2e4fad66a4f1a80/users/fda1bc91c37e48609db643b99990f9aa/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:24.914398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.914876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.915301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.959330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:24.959623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] MFA Rules not processed for user `fda1bc91c37e48609db643b99990f9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:24.959983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:24.960349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:24.960623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] PATH_INFO: `/v3/users/8efd5166db3e471faf788f166e15c6af` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:24.960811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:24.962027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efd5166db3e471faf788f166e15c6af)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:24.964213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:24.967019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:25.030763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efd5166db3e471faf788f166e15c6af'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.031660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efd5166db3e471faf788f166e15c6af'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.040709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efd5166db3e471faf788f166e15c6af'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.053204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1110/2214] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:25.063411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efd5166db3e471faf788f166e15c6af'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.064453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efd5166db3e471faf788f166e15c6af'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.066089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:25.068023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.105855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1105/2215] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:24 2022] DELETE /identity/v3/users/8efd5166db3e471faf788f166e15c6af => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:25.171155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed4bdd-1060-4fe0-b03b-ae5506fca3b0 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:25.186088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:25.223464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:25.225953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.247713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:25.248438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:25.248710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:25.249021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:25.253023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.336487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d48a-0a87-42a1-bdab-5330fabfccf6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:25.345305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:25.347792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:25.350715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:25.351542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:25.351941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:25.352296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] PATH_INFO: `/v3/users/1828bb9e93e2485fa55e9f068773930c` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:25.355425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1828bb9e93e2485fa55e9f068773930c)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:25.357643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:25.363483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1111/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:25.391913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:25.394774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.428026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59666-ea36-455f-97c0-e0fc178a77c8 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:25.443620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:25.444386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:25.444800 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:25.445161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] PATH_INFO: `/v3/users/fda1bc91c37e48609db643b99990f9aa` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:25.450347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda1bc91c37e48609db643b99990f9aa)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:25.452659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:25.491254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1828bb9e93e2485fa55e9f068773930c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.492817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1828bb9e93e2485fa55e9f068773930c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.515040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1828bb9e93e2485fa55e9f068773930c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.532643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1828bb9e93e2485fa55e9f068773930c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.534087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4a3740d9-1a10-4dbf-88a2-dd646455db17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1828bb9e93e2485fa55e9f068773930c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.564214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:25.572503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda1bc91c37e48609db643b99990f9aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.573890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1106/2217] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:25 2022] DELETE /identity/v3/users/1828bb9e93e2485fa55e9f068773930c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:25.574467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda1bc91c37e48609db643b99990f9aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.578715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d2e9-e9de-43bc-a808-88e47fa11557 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:25.583736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d2e9-e9de-43bc-a808-88e47fa11557 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:25.584347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d2e9-e9de-43bc-a808-88e47fa11557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:25.593376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda1bc91c37e48609db643b99990f9aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.635274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda1bc91c37e48609db643b99990f9aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.636028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda1bc91c37e48609db643b99990f9aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:25.641903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-68a3d2e9-e9de-43bc-a808-88e47fa11557 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:25.647729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-68a3d2e9-e9de-43bc-a808-88e47fa11557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.654835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1112/2218] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:25 2022] DELETE /identity/v3/users/fda1bc91c37e48609db643b99990f9aa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:25.655979 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:25.658279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.712080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:25.751235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441236c-c50f-4959-94c9-a23dd9e91887 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:25.757015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:25.758025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:25.758616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:25.758945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:25.761748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.801736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1107/2219] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:25.803454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:25.804637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:25.805083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:25.840980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:25.842823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.864523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:25.866033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:25.881477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1113/2220] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:25.881477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:25.884230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:25.989142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1108/2221] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:25.990555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:25.992379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.026572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0f6f-3b05-44ca-94c8-02189c2e952b service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.032852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.033720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.034194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.034623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] PATH_INFO: `/v3/projects/5dc009f3ac52438ba2a202b017fca2f3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.035992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc009f3ac52438ba2a202b017fca2f3)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.038189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:26.116199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc009f3ac52438ba2a202b017fca2f3', 'request_id': 'req-3c96b963-c1a9-44fd-8b29-4e74e1122177'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.123160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc009f3ac52438ba2a202b017fca2f3', 'request_id': 'req-3c96b963-c1a9-44fd-8b29-4e74e1122177'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.125378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68a5c2-e6e6-4284-8458-e600071c0953 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.137052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc009f3ac52438ba2a202b017fca2f3', 'request_id': 'req-3c96b963-c1a9-44fd-8b29-4e74e1122177'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.170275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] The token cache is being invalidate because project 5dc009f3ac52438ba2a202b017fca2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:26.171293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.172792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.176426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1114/2222] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:25 2022] DELETE /identity/v3/projects/5dc009f3ac52438ba2a202b017fca2f3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:26.177928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:26.181043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.221896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.222641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.222980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.223385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.225927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.230445 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:26.246634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:26.289195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b963-c1a9-44fd-8b29-4e74e1122177 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.293140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.293783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.294116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.294421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.296274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.348317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.349794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afda90-6b39-431d-8e17-cef7aa8de28e service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:26.364660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1109/2223] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:26.365453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.378757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.379073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.425184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:26.429729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.441084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1110/2224] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:26.441865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:26.443359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.457836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce95a8-3876-4f01-ad15-db69a61ee1a3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.476069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.476839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.478785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.478785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] PATH_INFO: `/v3/users/19045d22fadc4fa4b04b338d01e87407` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.480989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19045d22fadc4fa4b04b338d01e87407)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.489662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:26.496876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.499949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf59561-b4f8-4017-a173-3e2f3aa1d1ab service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:26.519419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1115/2225] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:26.521999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.522384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.522721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.566404 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:26.568020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.585486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1116/2226] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:26.587090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:26.606220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f685d0-0ee3-4018-9524-035747453b87 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.617520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19045d22fadc4fa4b04b338d01e87407'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.618463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19045d22fadc4fa4b04b338d01e87407'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.632910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19045d22fadc4fa4b04b338d01e87407'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.641224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.641921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.642214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.642449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.643230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:26.643578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.645289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:26.663214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19045d22fadc4fa4b04b338d01e87407'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.666059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-cfd47b14-0dd7-45cb-89ed-f4eaefccf2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19045d22fadc4fa4b04b338d01e87407'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:26.686524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1117/2227] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:26.690565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:26.693732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.697350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1111/2228] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:26 2022] DELETE /identity/v3/users/19045d22fadc4fa4b04b338d01e87407 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:26.699134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff9ead-1558-4165-b561-66550b95059a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.699433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff9ead-1558-4165-b561-66550b95059a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.699766 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff9ead-1558-4165-b561-66550b95059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.714720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d376f-3063-4af9-8c1d-618f0c1cc3f7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.725926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-17ff9ead-1558-4165-b561-66550b95059a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:26.727350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-17ff9ead-1558-4165-b561-66550b95059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.879808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1112/2229] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:26.914133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.915198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.915629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.916191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.917367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.917860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff9ead-1558-4165-b561-66550b95059a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:26.919473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-17ff9ead-1558-4165-b561-66550b95059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:26.920370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:26.950519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:26.985409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1118/2230] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:26 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:26.989777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.046084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:27.080690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff9ead-1558-4165-b561-66550b95059a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.084342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc18323-0a2d-41b4-9c43-e630df8c344d admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.098621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.099215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.099546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.099822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.100465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.102704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.134842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1119/2231] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:26 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:27.139482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.151236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd60a9-93d0-46b7-920d-00e556789a62 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.156437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.157052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.157327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.157652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.158405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.160787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.163851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.164608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.164881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.165153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.176472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1120/2232] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:27.179083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.181449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.181775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.193749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a1cd9-94a0-4c3a-b72f-a646efa07885 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.194302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1113/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:27.200605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff89ed3-e88a-4552-994f-40d9e571ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.201266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff89ed3-e88a-4552-994f-40d9e571ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.201665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff89ed3-e88a-4552-994f-40d9e571ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.201941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff89ed3-e88a-4552-994f-40d9e571ace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.202592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff89ed3-e88a-4552-994f-40d9e571ace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.204338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff89ed3-e88a-4552-994f-40d9e571ace8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.222821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1121/2234] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:27.226909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.239319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c7767-3b5d-4ee5-a042-fd8318c09a62 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.246199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.246982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.247821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.247821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] PATH_INFO: `/v3/projects/e243bc8b930c4c8ca254fac4f5c502b9/users/b39b169266f34147a65be562f17f7464/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.267190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e243bc8b930c4c8ca254fac4f5c502b9, user_id=b39b169266f34147a65be562f17f7464, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.270746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.294032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1114/2235] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:27 2022] PUT /identity/v3/projects/e243bc8b930c4c8ca254fac4f5c502b9/users/b39b169266f34147a65be562f17f7464/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:27.304766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.305060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.305327 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.343740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] MFA Rules not processed for user `b39b169266f34147a65be562f17f7464`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:27.345509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.415935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.418484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.437762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1122/2236] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:27.450999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.452416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.533575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60048b2-961f-4d04-8eaa-8c7c291c02fc admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.540001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.540661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.540938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.541367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] PATH_INFO: `/v3/projects/f7ef738ed03248d8bb8ccd5a31c6b8d6` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.543668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ef738ed03248d8bb8ccd5a31c6b8d6)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.546294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.573020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20e93-3676-400c-a9c9-6d6e3004b5c1 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.579033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.579877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.580162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.580432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.598770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.601416 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.614201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ef738ed03248d8bb8ccd5a31c6b8d6', 'request_id': 'req-9cbda46f-8404-43a2-b330-35d60aedf998'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.616157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:27.623020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ef738ed03248d8bb8ccd5a31c6b8d6', 'request_id': 'req-9cbda46f-8404-43a2-b330-35d60aedf998'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.634358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ef738ed03248d8bb8ccd5a31c6b8d6', 'request_id': 'req-9cbda46f-8404-43a2-b330-35d60aedf998'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.636466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1123/2237] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:27.638750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.646257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.660348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] The token cache is being invalidate because project f7ef738ed03248d8bb8ccd5a31c6b8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:27.660657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.661317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.667899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1115/2238] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:27 2022] DELETE /identity/v3/projects/f7ef738ed03248d8bb8ccd5a31c6b8d6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:27.669178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.673742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.686208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba32f13-4468-49ed-90db-4bf249579ac8 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.745632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:27.791477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda46f-8404-43a2-b330-35d60aedf998 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.797603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.798246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.800690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.801351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.801629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.801901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] PATH_INFO: `/v3/projects/942276ff43124ad3b2e4fad66a4f1a80` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.803084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942276ff43124ad3b2e4fad66a4f1a80)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.805024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.806227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.806706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] PATH_INFO: `/v3/users/dd963fed2f0048c791b0d180f9bba48b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.808325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd963fed2f0048c791b0d180f9bba48b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.810600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.897394 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd963fed2f0048c791b0d180f9bba48b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.898421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd963fed2f0048c791b0d180f9bba48b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.906547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942276ff43124ad3b2e4fad66a4f1a80', 'request_id': 'req-1a434fc4-95e7-43ea-a3b2-25b845351907'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.914301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942276ff43124ad3b2e4fad66a4f1a80', 'request_id': 'req-1a434fc4-95e7-43ea-a3b2-25b845351907'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.924450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd963fed2f0048c791b0d180f9bba48b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.927088 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942276ff43124ad3b2e4fad66a4f1a80', 'request_id': 'req-1a434fc4-95e7-43ea-a3b2-25b845351907'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.945845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] The token cache is being invalidate because project 942276ff43124ad3b2e4fad66a4f1a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:27.946779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.947821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a434fc4-95e7-43ea-a3b2-25b845351907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.950373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1124/2239] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:27 2022] DELETE /identity/v3/projects/942276ff43124ad3b2e4fad66a4f1a80 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:27.955030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd963fed2f0048c791b0d180f9bba48b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.956368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9398753b-cad8-4a17-84fa-d12695de7649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd963fed2f0048c791b0d180f9bba48b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.958320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8fcfe-4507-4a35-acf0-9ef9b1e04673 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.958790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8fcfe-4507-4a35-acf0-9ef9b1e04673 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.959512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8fcfe-4507-4a35-acf0-9ef9b1e04673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.992078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1116/2240] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:27 2022] DELETE /identity/v3/users/dd963fed2f0048c791b0d180f9bba48b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:27.996257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-19a8fcfe-4507-4a35-acf0-9ef9b1e04673 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:27.998176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-19a8fcfe-4507-4a35-acf0-9ef9b1e04673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.099587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1125/2241] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:28.105506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c566d56-835a-422a-8466-3aebb4276f1b None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.106007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c566d56-835a-422a-8466-3aebb4276f1b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.106346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c566d56-835a-422a-8466-3aebb4276f1b None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.107008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e781f-f53c-4b19-b269-1c9fe2860166 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.107340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e781f-f53c-4b19-b269-1c9fe2860166 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.107624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e781f-f53c-4b19-b269-1c9fe2860166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.108206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1117/2242] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:49:28.130428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c566d56-835a-422a-8466-3aebb4276f1b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.133156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7c566d56-835a-422a-8466-3aebb4276f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.137573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-837e781f-f53c-4b19-b269-1c9fe2860166 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:28.144253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-837e781f-f53c-4b19-b269-1c9fe2860166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.170755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c566d56-835a-422a-8466-3aebb4276f1b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.183823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1126/2243] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:28.185303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.185589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.185913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.188501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.189184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.190148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.190974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] PATH_INFO: `/v3/projects/2f39e7011a4f40caabbe4d8837406997` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.192539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f39e7011a4f40caabbe4d8837406997)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.196949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.216492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] MFA Rules not processed for user `422e32cb1eb345899ec4f2283d5fe828`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:28.218388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.288785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f39e7011a4f40caabbe4d8837406997', 'request_id': 'req-e8147818-c547-43b0-a32e-7a912705c74b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.293759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:28.303655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f39e7011a4f40caabbe4d8837406997', 'request_id': 'req-e8147818-c547-43b0-a32e-7a912705c74b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.314162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f39e7011a4f40caabbe4d8837406997', 'request_id': 'req-e8147818-c547-43b0-a32e-7a912705c74b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.338759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] The token cache is being invalidate because project 2f39e7011a4f40caabbe4d8837406997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:28.339274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.341231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.344979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1118/2244] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:28 2022] DELETE /identity/v3/projects/2f39e7011a4f40caabbe4d8837406997 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:28.346039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.347929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.349092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:28.377869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1127/2245] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:28.378762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.383823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.421066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591d92e-8d40-4687-9bec-04200b14c2f2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.467434 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147818-c547-43b0-a32e-7a912705c74b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.478533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.480801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.481142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.481908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.482038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:28.482341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.485037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.509349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1119/2246] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:28.510262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.512207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.516337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.517206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.517484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.517789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] PATH_INFO: `/v3/users/fbab55a55b194d2fb5a3837e3ff758fc` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.519948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbab55a55b194d2fb5a3837e3ff758fc)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.521946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.527496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c7a4-b113-4fd8-ae0a-5c3011381850 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.532996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.533948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.534377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.534948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] PATH_INFO: `/v3/users/cebd024378cb4eed89c004af82cb91cb` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.536141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebd024378cb4eed89c004af82cb91cb)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.538085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.582779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbab55a55b194d2fb5a3837e3ff758fc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.583881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbab55a55b194d2fb5a3837e3ff758fc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.595404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebd024378cb4eed89c004af82cb91cb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.595845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbab55a55b194d2fb5a3837e3ff758fc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.596122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebd024378cb4eed89c004af82cb91cb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.607395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebd024378cb4eed89c004af82cb91cb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.608502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbab55a55b194d2fb5a3837e3ff758fc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.609502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbab55a55b194d2fb5a3837e3ff758fc'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.622369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebd024378cb4eed89c004af82cb91cb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.623283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebd024378cb4eed89c004af82cb91cb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.626594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1128/2247] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:28 2022] DELETE /identity/v3/users/fbab55a55b194d2fb5a3837e3ff758fc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:28.627580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.629281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.641375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1120/2248] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:28 2022] DELETE /identity/v3/users/cebd024378cb4eed89c004af82cb91cb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:28.642324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.644903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.722979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:28.732565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ef178-96fe-4bc8-8f2a-6cb029ad3071 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.750233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb1d4-83ab-4e7f-8bc5-98006b3c2e5c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.752526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:28.757802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.758581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.758891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.759305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.760048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.764125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.805770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1121/2249] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:28 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:28.807318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.809616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.827530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.828559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.829045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.829540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.832967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.863386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.865159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.876701 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1129/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:28.877357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.890530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b386a9-20e9-4fe1-a8d0-779e884cade0 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.894301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b1569-dfd3-4724-a6f4-0639f3059c07 service placement] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.896512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.897422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.897762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.898092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] PATH_INFO: `/v3/projects/aa295671c2624632a82b664bd65f78b8` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.899381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa295671c2624632a82b664bd65f78b8)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.901406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.906032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.906922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.907417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.908266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.910733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.912980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.941856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1130/2251] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:28 2022] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:28.942945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.945119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.962703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa295671c2624632a82b664bd65f78b8', 'request_id': 'req-8afd0ac9-974c-4eb8-b32a-30f680d56f72'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.964315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafd1f8-15cd-425b-81e6-f8c0dd2103d5 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.971145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa295671c2624632a82b664bd65f78b8', 'request_id': 'req-8afd0ac9-974c-4eb8-b32a-30f680d56f72'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.979206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa295671c2624632a82b664bd65f78b8', 'request_id': 'req-8afd0ac9-974c-4eb8-b32a-30f680d56f72'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.998032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] The token cache is being invalidate because project aa295671c2624632a82b664bd65f78b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:28.998424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:28.999092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.000721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1122/2252] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:28 2022] DELETE /identity/v3/projects/aa295671c2624632a82b664bd65f78b8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:29.003289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.005295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.036854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.037784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.038261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.038573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] PATH_INFO: `/v3/projects/c6a11e9dac3c4ccfa658b43abde16efc` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.040980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a11e9dac3c4ccfa658b43abde16efc)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.044148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.080006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd0ac9-974c-4eb8-b32a-30f680d56f72 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.086203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:29.098398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a11e9dac3c4ccfa658b43abde16efc', 'request_id': 'req-d77acd55-b399-4350-b59b-9bde4be3e45d'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.106853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a11e9dac3c4ccfa658b43abde16efc', 'request_id': 'req-d77acd55-b399-4350-b59b-9bde4be3e45d'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.117533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a11e9dac3c4ccfa658b43abde16efc', 'request_id': 'req-d77acd55-b399-4350-b59b-9bde4be3e45d'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.131970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] The token cache is being invalidate because project c6a11e9dac3c4ccfa658b43abde16efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:29.132277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.132906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.134640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1131/2253] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:28 2022] DELETE /identity/v3/projects/c6a11e9dac3c4ccfa658b43abde16efc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:29.135366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.136707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.155086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.156190 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.156609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.156860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.158089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:29.160928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.162713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.179945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1123/2254] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:29.184281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.186239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.207377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a397-6707-4ca0-92e8-11a4dad4236c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.214385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.215217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.215518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.215782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] PATH_INFO: `/v3/projects/c0765a5674c649eb8a124396361cadbc` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.217462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0765a5674c649eb8a124396361cadbc)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.219659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.242672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77acd55-b399-4350-b59b-9bde4be3e45d admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.248407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.249055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.249334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.249578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] PATH_INFO: `/v3/users/62b3cfc90abb47189c1a34721f68214f` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.250807 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b3cfc90abb47189c1a34721f68214f)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.252860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.276287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0765a5674c649eb8a124396361cadbc', 'request_id': 'req-6a21ea15-ae12-4b66-9065-76db5b750faa'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.284384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0765a5674c649eb8a124396361cadbc', 'request_id': 'req-6a21ea15-ae12-4b66-9065-76db5b750faa'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.293216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0765a5674c649eb8a124396361cadbc', 'request_id': 'req-6a21ea15-ae12-4b66-9065-76db5b750faa'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.311518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b3cfc90abb47189c1a34721f68214f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.312334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b3cfc90abb47189c1a34721f68214f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.312801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] The token cache is being invalidate because project c0765a5674c649eb8a124396361cadbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:29.313399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.314219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6a21ea15-ae12-4b66-9065-76db5b750faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.316084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1124/2255] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:29 2022] DELETE /identity/v3/projects/c0765a5674c649eb8a124396361cadbc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:29.317299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.317580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.318030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.322050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b3cfc90abb47189c1a34721f68214f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.340079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b3cfc90abb47189c1a34721f68214f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.340871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b3cfc90abb47189c1a34721f68214f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.341037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:29.342268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.358957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1132/2256] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:29 2022] DELETE /identity/v3/users/62b3cfc90abb47189c1a34721f68214f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:29.359962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.361400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.436176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1125/2257] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:29.443068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.443068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.462035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d8a39-76c6-4306-9ac4-6880bb369713 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.495453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1c3aa-9bf6-43b6-b5fd-752d2a9dfde9 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.504011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd70be0-42a0-402b-8ce4-3a938f4aa528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.505160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70be0-42a0-402b-8ce4-3a938f4aa528 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.506021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70be0-42a0-402b-8ce4-3a938f4aa528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.506444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70be0-42a0-402b-8ce4-3a938f4aa528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.507554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd70be0-42a0-402b-8ce4-3a938f4aa528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.510081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd70be0-42a0-402b-8ce4-3a938f4aa528 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.519861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:29.529068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1133/2258] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:29.530895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.531818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.532838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.563913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:29.565155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.594787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.596418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.596905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.597488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] PATH_INFO: `/v3/users/db5fe19eaf80423bbd036a7d87da10d4` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.599079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1134/2259] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:29.599685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5fe19eaf80423bbd036a7d87da10d4)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.600072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.603145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.611018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e47d6-394f-4238-b990-0d735a1103e5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.616840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.617623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.617903 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.618172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] PATH_INFO: `/v3/projects/67c539fc0e6647c2ae39e8bf77baf842/users/116ef7a03ff64293afda0366483d377e/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.639548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c539fc0e6647c2ae39e8bf77baf842, user_id=116ef7a03ff64293afda0366483d377e, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.642887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.674423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1135/2260] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:29 2022] PUT /identity/v3/projects/67c539fc0e6647c2ae39e8bf77baf842/users/116ef7a03ff64293afda0366483d377e/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:29.675860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.690827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5fe19eaf80423bbd036a7d87da10d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.691648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:29.691776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5fe19eaf80423bbd036a7d87da10d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.702519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5fe19eaf80423bbd036a7d87da10d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.725199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5fe19eaf80423bbd036a7d87da10d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.725985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-79be78df-b9f3-4a05-8e17-3635f6678a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5fe19eaf80423bbd036a7d87da10d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:29.762341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1126/2261] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:29 2022] DELETE /identity/v3/users/db5fe19eaf80423bbd036a7d87da10d4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:29.767538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.767538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.768231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.805593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] MFA Rules not processed for user `116ef7a03ff64293afda0366483d377e`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:29.807194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.820409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564e1b-9cb7-45cc-8c1b-3da8f7d08117 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.901971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1127/2262] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:29.903570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.905646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.938218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.940056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.940544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.940898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.942126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:29.943363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:29.945966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:29.964271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1136/2263] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:29.964726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:29.966918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:29.970860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:29.987900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723ffdf-c1dc-4669-a88b-7deffb1c62f0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:29.995333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:29.995961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:29.996294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:29.996514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:29.997157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.000620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.014747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce04ba-cbcf-411b-b527-846ebef7eb3e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.022389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.023211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.023493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.023824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] PATH_INFO: `/v3/projects/dc2b9064b66943588279fb8a5bf1ea5d` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.025041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2b9064b66943588279fb8a5bf1ea5d)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.027223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.062759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1137/2264] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:29 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:30.063382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.065597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.101941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2b9064b66943588279fb8a5bf1ea5d', 'request_id': 'req-6c799638-8227-48a4-bba7-137cb66d87b2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.110510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2b9064b66943588279fb8a5bf1ea5d', 'request_id': 'req-6c799638-8227-48a4-bba7-137cb66d87b2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.117520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2b9064b66943588279fb8a5bf1ea5d', 'request_id': 'req-6c799638-8227-48a4-bba7-137cb66d87b2'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.136877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] The token cache is being invalidate because project dc2b9064b66943588279fb8a5bf1ea5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:30.137300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.138401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.139952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1128/2265] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:29 2022] DELETE /identity/v3/projects/dc2b9064b66943588279fb8a5bf1ea5d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:30.140824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.143047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.166299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f40fc-0438-402e-aae7-d25e51c0c767 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.201486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:30.225191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c799638-8227-48a4-bba7-137cb66d87b2 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.231254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42e87-da32-4db6-a274-70a8a39b4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.231771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42e87-da32-4db6-a274-70a8a39b4838 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.232042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42e87-da32-4db6-a274-70a8a39b4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.232305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42e87-da32-4db6-a274-70a8a39b4838 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.232963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42e87-da32-4db6-a274-70a8a39b4838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.234997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42e87-da32-4db6-a274-70a8a39b4838 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.240268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.240928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.241385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.241590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.242306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.244267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.260264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1129/2266] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:30.261592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.261879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.262143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.280095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1138/2267] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:30.280095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.284667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.286615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:30.287986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.346968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:30.362203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1130/2268] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:30.363439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.371360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91c4ac-abe6-4027-a6a1-4b26bffa88e0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.374268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508aac-2707-41a9-8f5b-1c68cef24df6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.378287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c546-cd29-424d-8293-276007858000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.379113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c546-cd29-424d-8293-276007858000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.379332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c546-cd29-424d-8293-276007858000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.379504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c546-cd29-424d-8293-276007858000 admin admin] PATH_INFO: `/v3/projects/61397702e0564ddaaffb8797814b92ab` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.380761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c546-cd29-424d-8293-276007858000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61397702e0564ddaaffb8797814b92ab)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.381529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.382304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.382576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.382965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.383740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.385441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.387017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c546-cd29-424d-8293-276007858000 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.405586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1131/2269] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:30.407875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.409897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.424688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741d06d-a505-4536-b4b2-c236aac2ea11 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.429953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af0ef1-5fcb-4f3e-8481-0708aa657963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.430567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af0ef1-5fcb-4f3e-8481-0708aa657963 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.430883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af0ef1-5fcb-4f3e-8481-0708aa657963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.431155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af0ef1-5fcb-4f3e-8481-0708aa657963 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.431792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af0ef1-5fcb-4f3e-8481-0708aa657963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.433754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af0ef1-5fcb-4f3e-8481-0708aa657963 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.442934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61397702e0564ddaaffb8797814b92ab', 'request_id': 'req-a042c546-cd29-424d-8293-276007858000'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.449536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61397702e0564ddaaffb8797814b92ab', 'request_id': 'req-a042c546-cd29-424d-8293-276007858000'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.457772 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61397702e0564ddaaffb8797814b92ab', 'request_id': 'req-a042c546-cd29-424d-8293-276007858000'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.462176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1132/2270] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:30.462176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.462176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.462176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.469632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a042c546-cd29-424d-8293-276007858000 admin admin] The token cache is being invalidate because project 61397702e0564ddaaffb8797814b92ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:30.469928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.470763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:30.472366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1139/2271] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:30 2022] DELETE /identity/v3/projects/61397702e0564ddaaffb8797814b92ab => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:30.473169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.474476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.481493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:30.482675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.522261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:30.542263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c546-cd29-424d-8293-276007858000 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.545165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1133/2272] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:30.545976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.547458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.550232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.550936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.551260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.551533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] PATH_INFO: `/v3/projects/217b6ab34b874acf8b3de1221a700604/users/a9d62aae5a9e4fc2b4ef20ce7dc59544/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.559104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9968c-361d-442f-831c-9ba27d6970f5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.563706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ddb0f-d6c0-4ba7-ba81-cdcdaace3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.564303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ddb0f-d6c0-4ba7-ba81-cdcdaace3395 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.564581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ddb0f-d6c0-4ba7-ba81-cdcdaace3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.564855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ddb0f-d6c0-4ba7-ba81-cdcdaace3395 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.565532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ddb0f-d6c0-4ba7-ba81-cdcdaace3395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.567204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ddb0f-d6c0-4ba7-ba81-cdcdaace3395 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.567523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217b6ab34b874acf8b3de1221a700604, user_id=a9d62aae5a9e4fc2b4ef20ce7dc59544, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.570170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.577252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1134/2273] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:30.578547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.578857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.579170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.585345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1140/2274] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:30 2022] PUT /identity/v3/projects/217b6ab34b874acf8b3de1221a700604/users/a9d62aae5a9e4fc2b4ef20ce7dc59544/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:30.586004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.602006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:30.603253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.650795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7d79-e24d-46c5-8706-f9d26ab96566 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.656436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.657203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.657481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.657774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.658471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:30.658811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.662070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.667059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1135/2275] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:30.667921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.676266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1141/2276] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:30.677092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.688128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f7f45-b732-4f9f-b67d-bd9f6815d180 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.688277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd932932-1e78-4fd9-90af-381995f6da9c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.693456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e982c-9f8e-4e84-bf67-258afd47232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.693700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.693985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e982c-9f8e-4e84-bf67-258afd47232f admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.694259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e982c-9f8e-4e84-bf67-258afd47232f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.694365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.694556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e982c-9f8e-4e84-bf67-258afd47232f admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.694655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.694853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.695447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e982c-9f8e-4e84-bf67-258afd47232f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.695552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.697041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e982c-9f8e-4e84-bf67-258afd47232f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.697145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.709948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1136/2277] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:30.711457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.711742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.712071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.715695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1142/2278] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:30.717024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.732524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4d598-9590-4cf6-8836-b26a6711f035 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.742765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.742765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.742765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.742765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.743234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.743234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.750986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:30.752877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.762367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1137/2279] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:30.764430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.776877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd092-d7b9-4494-a181-0415e7ab0a87 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.781677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1143/2280] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:30.782464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.783374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.783492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.783921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.784189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] PATH_INFO: `/v3/projects/d2c8a104404d4065aa01c083531e595b/users/3c995c3fcae24fffb1a3a2147a9d6d1a/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.801148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c8a104404d4065aa01c083531e595b, user_id=3c995c3fcae24fffb1a3a2147a9d6d1a, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.803985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.826214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1138/2281] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:30 2022] PUT /identity/v3/projects/d2c8a104404d4065aa01c083531e595b/users/3c995c3fcae24fffb1a3a2147a9d6d1a/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:30.826214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.850707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:30.867827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ee16c-5298-412a-a2ef-ffec051c27db admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.900731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb71cb-038b-4701-a66f-16f9ad8b5c8e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.901870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:30.905794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.906561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.906942 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.907280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.907950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:30.908252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.910361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.922395 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1139/2282] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:30.923273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.928457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded88ae-8e98-46be-a7f9-b9c47c8017fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.929113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded88ae-8e98-46be-a7f9-b9c47c8017fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.929535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded88ae-8e98-46be-a7f9-b9c47c8017fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.929802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded88ae-8e98-46be-a7f9-b9c47c8017fd admin admin] PATH_INFO: `/v3/projects/217b6ab34b874acf8b3de1221a700604/users/a9d62aae5a9e4fc2b4ef20ce7dc59544/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.931977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded88ae-8e98-46be-a7f9-b9c47c8017fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=217b6ab34b874acf8b3de1221a700604, user_id=a9d62aae5a9e4fc2b4ef20ce7dc59544, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.933133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c770d-3d01-4405-9a68-c1004de1d942 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:30.934637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded88ae-8e98-46be-a7f9-b9c47c8017fd admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.938140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:30.938912 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.939196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.939468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.940108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:30.942061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:30.945150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1144/2283] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:30 2022] PUT /identity/v3/projects/217b6ab34b874acf8b3de1221a700604/users/a9d62aae5a9e4fc2b4ef20ce7dc59544/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:30.946278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df129fa-3b6b-4218-a296-bbf00c9dbf1d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:30.946554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df129fa-3b6b-4218-a296-bbf00c9dbf1d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:30.946938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df129fa-3b6b-4218-a296-bbf00c9dbf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:30.965698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1140/2284] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:30.966304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:30.969333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6df129fa-3b6b-4218-a296-bbf00c9dbf1d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:30.970804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6df129fa-3b6b-4218-a296-bbf00c9dbf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:30.976386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ece3-d3a1-4ec0-991d-a45a1e71f58f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.031986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.032597 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1145/2285] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:31.032757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.034008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.034290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.034557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.035006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.035389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.039314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.041273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.066093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] MFA Rules not processed for user `a9d62aae5a9e4fc2b4ef20ce7dc59544`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:31.077549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.077846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1141/2286] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:30 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:31.077846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.146368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8bc82-9ad2-41c4-aa13-079cc820ebcd admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.152001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.152851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.153222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.153582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.154335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.154651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1146/2287] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:31.155637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.156415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.156986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.173715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1142/2288] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:31.178281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.191672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bdf6-398e-4857-be28-2afd6c7228fb admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.196441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.197050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.197393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.197724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.198416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.200571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.218628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:31.226732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1143/2289] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:31 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:31.230627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55385a-16f4-4c70-9018-6e030ccdae7b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.230907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.232740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.239405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:31.286750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.287341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.287617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.287891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.297289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.299038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.299874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788352-efcc-41f1-838a-80cb6eb69f07 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.304000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.304623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.304903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.305176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.307116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.309986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1147/2290] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:31.310829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.326102 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df52f-7dd6-4919-8ff0-963cb5006b17 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.333322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.334243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.334534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.334840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.335514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.338667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.351609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1148/2291] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:31.352716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.365074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647089-1a92-4068-95ca-26b267cb2475 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.380672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.381479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.382031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.383108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.384046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.386869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.387991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.391730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.406198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1149/2292] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:31.407136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.419815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8b945-a805-4d24-a10a-436148c14982 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.426464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1144/2293] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:31.426588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8750d1-d56c-4d83-b884-f6cc1a1539ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.427405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8750d1-d56c-4d83-b884-f6cc1a1539ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.427678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8750d1-d56c-4d83-b884-f6cc1a1539ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.428106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8750d1-d56c-4d83-b884-f6cc1a1539ff admin admin] PATH_INFO: `/v3/projects/c1f9ea3020bd49658f56e7fcd44233a2/users/9f808c9a93784ba39f6da88465fc46fc/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.428719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.446361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8750d1-d56c-4d83-b884-f6cc1a1539ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f9ea3020bd49658f56e7fcd44233a2, user_id=9f808c9a93784ba39f6da88465fc46fc, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.449704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8750d1-d56c-4d83-b884-f6cc1a1539ff admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.454623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7ad5d-8097-4c1f-be17-e80c71a51c98 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.475185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.475185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.475185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.475185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.475563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.475563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.497629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1150/2294] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:31 2022] PUT /identity/v3/projects/c1f9ea3020bd49658f56e7fcd44233a2/users/9f808c9a93784ba39f6da88465fc46fc/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:31.498142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1145/2295] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:31.499582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.500712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.502410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.503407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.519880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe97e0-5e68-4316-8983-41ea89b7d082 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.561953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:31.568692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.659388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.660233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.660581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.660865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] PATH_INFO: `/v3/projects/1b66d2f7930b4a73bf4608b84c8cd791/users/d4de7d153d704d4fa18cc1d8eb70eb0e/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.684213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1151/2296] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:31.685306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.687136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b66d2f7930b4a73bf4608b84c8cd791, user_id=d4de7d153d704d4fa18cc1d8eb70eb0e, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.688259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.691058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.710919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10cdd2-e0ec-4e80-9b8e-856fb98acd15 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.719956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1146/2297] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:31 2022] PUT /identity/v3/projects/1b66d2f7930b4a73bf4608b84c8cd791/users/d4de7d153d704d4fa18cc1d8eb70eb0e/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:31.723616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:31.725862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.801855 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:31.814031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.814744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.815519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.815969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] PATH_INFO: `/v3/users/94d429a932e64728ae7c4cbb47db9aee` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.817599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d429a932e64728ae7c4cbb47db9aee)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.819722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.833469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:31.894445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447df5-5dcd-4196-a372-71347cf4768e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:31.898953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24a368-5479-495b-9036-878f0bd18436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:31.899716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24a368-5479-495b-9036-878f0bd18436 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.900061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24a368-5479-495b-9036-878f0bd18436 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.900436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24a368-5479-495b-9036-878f0bd18436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.903891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d429a932e64728ae7c4cbb47db9aee'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:31.905412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d429a932e64728ae7c4cbb47db9aee'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:31.911511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24a368-5479-495b-9036-878f0bd18436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:31.913231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24a368-5479-495b-9036-878f0bd18436 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:31.922244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d429a932e64728ae7c4cbb47db9aee'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:31.925193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1147/2298] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:31.926671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.927048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.927387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:31.951913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d429a932e64728ae7c4cbb47db9aee'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:31.952855 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db59979a-be6b-4c19-aeb4-6351db6208d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d429a932e64728ae7c4cbb47db9aee'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:31.960748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] MFA Rules not processed for user `d4de7d153d704d4fa18cc1d8eb70eb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:31.962472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:31.980767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1152/2299] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:31 2022] DELETE /identity/v3/users/94d429a932e64728ae7c4cbb47db9aee => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:31.985542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:31.986010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:31.986452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:32.045452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:32.049882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:32.066731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1148/2300] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:32.081865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:32.084531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:32.154434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1153/2301] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:32.179096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:32.180465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:32.181312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e13548-4e1b-4ea6-b53a-069aedc935f9 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:32.278835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce20fe-9ed7-4897-9a1a-bddc201f6e0f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:32.283132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:32.283912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:32.284854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:32.284854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:32.290640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:32.291327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:32.291629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:32.292010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:32.296702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:32.298467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:32.312294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1154/2302] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:32.335874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:32.378442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:32.380458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:32.394128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1149/2303] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:49:32.993884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:32.995596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:33.034612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68756-8f3a-4045-a768-017ad6e4a87f service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:33.060433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:33.061260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:33.061518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:33.068346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] PATH_INFO: `/v3/projects/6c1c775d506b45bcbff49a2e6b9b3001` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:33.070455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1c775d506b45bcbff49a2e6b9b3001)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:33.072539 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:33.115825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:33.149129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1c775d506b45bcbff49a2e6b9b3001', 'request_id': 'req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.167469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1c775d506b45bcbff49a2e6b9b3001', 'request_id': 'req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.184095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1c775d506b45bcbff49a2e6b9b3001', 'request_id': 'req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.209928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] The token cache is being invalidate because project 6c1c775d506b45bcbff49a2e6b9b3001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:33.210316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.211336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-57610c63-5a1e-4b54-95ab-55c87b4d1ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.213510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1155/2304] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:32 2022] DELETE /identity/v3/projects/6c1c775d506b45bcbff49a2e6b9b3001 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:33.217322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:33.229948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a688bb-32be-4c35-982b-7c8b4ff206ef service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:33.345808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:33.346475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:33.346796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:33.347065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] PATH_INFO: `/v3/users/51bf82ac45fd49a6a52c2e9a04fcc9cc` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:33.349029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bf82ac45fd49a6a52c2e9a04fcc9cc)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:33.351123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:33.430069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bf82ac45fd49a6a52c2e9a04fcc9cc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.431160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bf82ac45fd49a6a52c2e9a04fcc9cc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.439799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bf82ac45fd49a6a52c2e9a04fcc9cc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.458116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bf82ac45fd49a6a52c2e9a04fcc9cc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.459471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bf82ac45fd49a6a52c2e9a04fcc9cc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:33.486784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1150/2305] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:33 2022] DELETE /identity/v3/users/51bf82ac45fd49a6a52c2e9a04fcc9cc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:33.780598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:33.781272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:33.781833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:33.835155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] MFA Rules not processed for user `9f808c9a93784ba39f6da88465fc46fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:33.857174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.077690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1156/2306] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:34.173698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:34.175209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.211371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:34.214236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.266607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:34.275916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef18e2-51bd-4ea9-82c8-fa727561ed0f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:34.289685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:34.290832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:34.291224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:34.291612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:34.303508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:34.305258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:34.315800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1151/2307] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:34.331532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7a98c-46f6-4fc9-aab0-735b3b10bb84 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:34.338033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:34.338549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:34.339002 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:34.339367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] PATH_INFO: `/v3/projects/f45583cffcae4e23a4a4ec585bdf0ffc` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:34.340814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45583cffcae4e23a4a4ec585bdf0ffc)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:34.345093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:34.414019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:34.418966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45583cffcae4e23a4a4ec585bdf0ffc', 'request_id': 'req-1af81e45-3692-486d-9dd6-2253d997d1d8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.427870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45583cffcae4e23a4a4ec585bdf0ffc', 'request_id': 'req-1af81e45-3692-486d-9dd6-2253d997d1d8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.442556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45583cffcae4e23a4a4ec585bdf0ffc', 'request_id': 'req-1af81e45-3692-486d-9dd6-2253d997d1d8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.454254 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:34.457513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.476781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] The token cache is being invalidate because project f45583cffcae4e23a4a4ec585bdf0ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:34.477669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.478398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1af81e45-3692-486d-9dd6-2253d997d1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.484606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1157/2308] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:34 2022] DELETE /identity/v3/projects/f45583cffcae4e23a4a4ec585bdf0ffc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:34.489851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016da130-e93b-4fcf-99f1-a501c81bd2fb service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:34.490905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b55a-3c94-469e-8fdb-e926f76b6f85 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:34.491353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b55a-3c94-469e-8fdb-e926f76b6f85 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:34.491637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b55a-3c94-469e-8fdb-e926f76b6f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:34.540557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-a3a4b55a-3c94-469e-8fdb-e926f76b6f85 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:34.544081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a3a4b55a-3c94-469e-8fdb-e926f76b6f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.591162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:34.592784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:34.593156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:34.604077 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] PATH_INFO: `/v3/users/116ef7a03ff64293afda0366483d377e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:34.607048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116ef7a03ff64293afda0366483d377e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:34.609706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:34.702039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116ef7a03ff64293afda0366483d377e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.702877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116ef7a03ff64293afda0366483d377e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.733964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116ef7a03ff64293afda0366483d377e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.753608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116ef7a03ff64293afda0366483d377e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.754850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0680b18f-7e3b-4028-913d-d010afd0c9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116ef7a03ff64293afda0366483d377e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:34.796453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1152/2309] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:34 2022] DELETE /identity/v3/users/116ef7a03ff64293afda0366483d377e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:34.798137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:34.798532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:34.798969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:34.825014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:34.826255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.912600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1158/2310] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:34.921266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:34.921630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:34.922058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:34.956538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:34.958217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:34.967103 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1159/2311] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:34.968263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1153/2312] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:34.972537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:34.988642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be59e-f0dc-4f40-936d-4cc8128e5908 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.003386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.016095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:35.020729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.022165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.022651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.023420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.024804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:35.025558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.032046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.041160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:35.072177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1160/2313] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:35.077660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.096570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361e6eb-2a2b-4954-bab1-5f81baa1f98c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.109688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.113608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.113982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.114354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.115582 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.119998 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.141184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3beb-837b-4203-aa94-0319bf67894c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.145079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.145708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.145985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.146326 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.156680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.158205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.176810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1154/2314] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:35.187317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1161/2315] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:35 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:35.191784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.211169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4b13-bb3d-424e-8e11-35b2495a3033 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.283833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.284945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.285306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.285646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.286437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.288662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.315891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1155/2316] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:35 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:35.320108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.334750 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ac62-121d-4e6b-832e-a02f89716b42 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.344910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.345999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.346454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.346929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.348409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.350866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.366730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1162/2317] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:35.370639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.381218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aabc2-f909-435d-8f7d-8fa805975d76 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.386356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.387245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.387624 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.388534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.388838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.390560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.411316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1156/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:35.413730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.438919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df0d62-72e8-4cdc-8620-0be8abae1178 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.445732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70559279-6106-4126-9ce1-e1c84522c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.445732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70559279-6106-4126-9ce1-e1c84522c0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.445732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70559279-6106-4126-9ce1-e1c84522c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.445732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70559279-6106-4126-9ce1-e1c84522c0a5 admin admin] PATH_INFO: `/v3/projects/412df48d7e474810b31b236574b27814/users/81b45e6bf66f4dbd8d123aa5c23791f0/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.462435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.467977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:35.489001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70559279-6106-4126-9ce1-e1c84522c0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412df48d7e474810b31b236574b27814, user_id=81b45e6bf66f4dbd8d123aa5c23791f0, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.493960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70559279-6106-4126-9ce1-e1c84522c0a5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.502100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b965-3583-4d24-9486-1bfe04704960 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.520357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:35.531783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1163/2319] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:35 2022] PUT /identity/v3/projects/412df48d7e474810b31b236574b27814/users/81b45e6bf66f4dbd8d123aa5c23791f0/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:35.532318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.532318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.532318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] PATH_INFO: `/v3/users/d4de7d153d704d4fa18cc1d8eb70eb0e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.532318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4de7d153d704d4fa18cc1d8eb70eb0e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:35.532989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:35.536670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.537595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.537869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.615097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] MFA Rules not processed for user `81b45e6bf66f4dbd8d123aa5c23791f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:35.617562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:35.728591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4de7d153d704d4fa18cc1d8eb70eb0e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:35.732421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4de7d153d704d4fa18cc1d8eb70eb0e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:35.732586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:35.748087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4de7d153d704d4fa18cc1d8eb70eb0e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:35.769037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4de7d153d704d4fa18cc1d8eb70eb0e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:35.770096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-00426b11-f16f-498b-9ebe-7d2f12fbfa0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4de7d153d704d4fa18cc1d8eb70eb0e'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:35.781361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1164/2320] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:35.796096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1157/2321] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:35 2022] DELETE /identity/v3/users/d4de7d153d704d4fa18cc1d8eb70eb0e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:35.796291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.797685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:35.801999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:35.805508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:35.807159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:35.825637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:35.863958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:35.865654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:35.961854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1158/2322] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:35.963007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:35.973380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:35.986402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8407ea-18e4-456b-917f-7e13cf6b2fde None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:35.999898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76b50f-6d3d-4abb-9cb6-992d243b4971 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:36.011653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:36.017492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:36.021599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:36.022181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] PATH_INFO: `/v3/projects/67c539fc0e6647c2ae39e8bf77baf842` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:36.026802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c539fc0e6647c2ae39e8bf77baf842)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:36.031663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:36.096678 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:36.097406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:36.097935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:36.098056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:36.100199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:36.101526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c539fc0e6647c2ae39e8bf77baf842', 'request_id': 'req-5d6b154c-a029-4cdd-bc49-19e78c06a598'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.128817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c539fc0e6647c2ae39e8bf77baf842', 'request_id': 'req-5d6b154c-a029-4cdd-bc49-19e78c06a598'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.146501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c539fc0e6647c2ae39e8bf77baf842', 'request_id': 'req-5d6b154c-a029-4cdd-bc49-19e78c06a598'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.184014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] The token cache is being invalidate because project 67c539fc0e6647c2ae39e8bf77baf842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:36.184371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.184984 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.188803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1159/2323] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:35 2022] DELETE /identity/v3/projects/67c539fc0e6647c2ae39e8bf77baf842 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:36.191770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:36.199665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:36.211669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:36.213960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:36.243295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1165/2324] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:36.244281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:36.266729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515833-6f63-48f6-bc12-955714d0d955 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:36.306353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b154c-a029-4cdd-bc49-19e78c06a598 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:36.316365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:36.316999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:36.317279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:36.317546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:36.322148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:36.415280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:36.432739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:36.433394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:36.433668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:36.433937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] PATH_INFO: `/v3/users/a9d62aae5a9e4fc2b4ef20ce7dc59544` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:36.439644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d62aae5a9e4fc2b4ef20ce7dc59544)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:36.445640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:36.450782 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:36.501527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:36.504362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7ffdc-a235-418c-abb9-32e64c7eadaa service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:36.519763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1160/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:36.521713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:36.521713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:36.521917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:36.551602 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d62aae5a9e4fc2b4ef20ce7dc59544'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.552275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d62aae5a9e4fc2b4ef20ce7dc59544'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.565538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d62aae5a9e4fc2b4ef20ce7dc59544'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.567780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] MFA Rules not processed for user `9f808c9a93784ba39f6da88465fc46fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:36.568607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:36.591179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d62aae5a9e4fc2b4ef20ce7dc59544'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.592651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d62aae5a9e4fc2b4ef20ce7dc59544'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:36.625770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1166/2326] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:36 2022] DELETE /identity/v3/users/a9d62aae5a9e4fc2b4ef20ce7dc59544 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:36.662078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1161/2327] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:37.756235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:37.759924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:37.791776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:37.793315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:37.820548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac114ca-07be-4822-ae7a-8362e8de089b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:37.917858 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2446a4-940f-4a90-8e3f-6c5950a3a4ae admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:37.922461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:37.923296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:37.923632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:37.924024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] PATH_INFO: `/v3/projects/1b66d2f7930b4a73bf4608b84c8cd791` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:37.925278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b66d2f7930b4a73bf4608b84c8cd791)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:37.927521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:37.969587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:37.970616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:37.970616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:37.971979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] PATH_INFO: `/v3/projects/217b6ab34b874acf8b3de1221a700604` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:37.973688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217b6ab34b874acf8b3de1221a700604)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:37.976025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.058918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b66d2f7930b4a73bf4608b84c8cd791', 'request_id': 'req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.088851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b66d2f7930b4a73bf4608b84c8cd791', 'request_id': 'req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.105283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217b6ab34b874acf8b3de1221a700604', 'request_id': 'req-c22b6be6-4f85-4df0-884c-bf7819372b31'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.110835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b66d2f7930b4a73bf4608b84c8cd791', 'request_id': 'req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.125233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217b6ab34b874acf8b3de1221a700604', 'request_id': 'req-c22b6be6-4f85-4df0-884c-bf7819372b31'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.127694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] The token cache is being invalidate because project 1b66d2f7930b4a73bf4608b84c8cd791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:38.128010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.131031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-fa28c3c3-5b2c-4cb9-a153-897d35e8c51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.134388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1167/2328] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:37 2022] DELETE /identity/v3/projects/1b66d2f7930b4a73bf4608b84c8cd791 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:38.140272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683b8d-0513-4d56-8b78-add2654c3ae9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.140551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683b8d-0513-4d56-8b78-add2654c3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.140910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683b8d-0513-4d56-8b78-add2654c3ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.144671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217b6ab34b874acf8b3de1221a700604', 'request_id': 'req-c22b6be6-4f85-4df0-884c-bf7819372b31'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.188392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] The token cache is being invalidate because project 217b6ab34b874acf8b3de1221a700604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:38.189034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.192647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c22b6be6-4f85-4df0-884c-bf7819372b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:38.199697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:38.203551 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1162/2329] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:37 2022] DELETE /identity/v3/projects/217b6ab34b874acf8b3de1221a700604 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:49:38.208935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006b760-76bf-4ac5-af92-4cc7d498abca None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.214143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006b760-76bf-4ac5-af92-4cc7d498abca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.214953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006b760-76bf-4ac5-af92-4cc7d498abca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.215615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1e683b8d-0513-4d56-8b78-add2654c3ae9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:38.217349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1e683b8d-0513-4d56-8b78-add2654c3ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:38.288039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c006b760-76bf-4ac5-af92-4cc7d498abca None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:38.289287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c006b760-76bf-4ac5-af92-4cc7d498abca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:38.305026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:38.381067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1168/2330] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:38.390824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.391114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.391388 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.462139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:38.463234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1163/2331] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:38.464888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.465034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:38.465132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.465132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.490161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1169/2332] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:38.491360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.517019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:38.518247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:38.528228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3af7b-98a1-4230-912f-ca4e109cf168 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.543865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.544173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1164/2333] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:38.544894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.545223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.545761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.546222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.547175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:38.547866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.551116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.567335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18df48-9b9f-4054-bc33-70a2483f4620 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.585660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1170/2334] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:38.586348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.587116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.587490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.587859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.588658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:38.589359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.591197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.592287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.632683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014b37-435c-43c7-bc26-4d2038203d98 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.641115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.641796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.642016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.642286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.643051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.647136 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.648610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1165/2335] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:38.649653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.667086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04611-b83f-4a7c-bd52-9fb9a37510c9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.680689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.681555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.681954 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.683132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.683960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.686831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.718381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1171/2336] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:38.719466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.738826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1166/2337] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:38.740117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.874620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08117e-9411-4921-88f5-aade1fc9b1ed admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.876879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668b54f-e430-48e4-9f5a-024f4ca4a015 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.884788 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.885300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cb074-1e32-4d2e-bc96-bdaade9b0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.885685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.885939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cb074-1e32-4d2e-bc96-bdaade9b0012 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.886221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cb074-1e32-4d2e-bc96-bdaade9b0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.886491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cb074-1e32-4d2e-bc96-bdaade9b0012 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.886674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.887339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cb074-1e32-4d2e-bc96-bdaade9b0012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.887618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.889134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.889279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cb074-1e32-4d2e-bc96-bdaade9b0012 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.892981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.927427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1167/2338] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:38.928079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1172/2339] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:38.929730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.930166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.930895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.931692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:38.952627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4627b4-60a8-4659-a72b-7b00740bd7cb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:38.975596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:38.976251 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:38.976532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:38.976799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:38.977464 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:38.979834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:38.985566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] MFA Rules not processed for user `3c995c3fcae24fffb1a3a2147a9d6d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:38.987718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:38.994953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1173/2340] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:38.996842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.011415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daaadc-4d11-4ba0-9795-3162801fabde admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.017710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.019095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.019583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.020315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.021163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.023520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.037270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1174/2341] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:39.038227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.043046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:39.050921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854a65-16af-47b7-82e4-8afda5f1f8b7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.057298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.058076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.058358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.058633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.059329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.061109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.067639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1168/2342] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:39.071755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.073016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1175/2343] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:39.079691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.089150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e968-08ec-4242-a2c2-07cc3ab60830 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.091570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292bf2-caab-41c3-b256-fe479db425c5 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.096761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.097553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.097832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.098102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.098793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.100462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.100668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.103632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.103919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.104196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] PATH_INFO: `/v3/projects/aed7ec45099543999e98f86417d82120/users/0f5e52ab3f044e2e9123d984e4b5f8c3/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.112136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1169/2344] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:39.113010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.114758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:39.124287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed7ec45099543999e98f86417d82120, user_id=0f5e52ab3f044e2e9123d984e4b5f8c3, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.127160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.138868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:39.146114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1176/2345] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:39 2022] PUT /identity/v3/projects/aed7ec45099543999e98f86417d82120/users/0f5e52ab3f044e2e9123d984e4b5f8c3/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:39.147054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.208865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bcd23-233c-4dd3-9747-c2d234a9540d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.221015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781ff8a-5535-4717-bdb0-7e51935f6d70 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.226263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825da95-5f5c-4f8a-a3c2-946085713163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.226967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825da95-5f5c-4f8a-a3c2-946085713163 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.227694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825da95-5f5c-4f8a-a3c2-946085713163 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.227973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825da95-5f5c-4f8a-a3c2-946085713163 admin admin] PATH_INFO: `/v3/projects/ca463130ab6a4a33b0868791fa5e1b4c/users/4c9b9b2d137447f2b83cd2cb3168ffc0/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.245380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825da95-5f5c-4f8a-a3c2-946085713163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca463130ab6a4a33b0868791fa5e1b4c, user_id=4c9b9b2d137447f2b83cd2cb3168ffc0, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.248223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825da95-5f5c-4f8a-a3c2-946085713163 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.283066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1177/2346] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:39 2022] PUT /identity/v3/projects/ca463130ab6a4a33b0868791fa5e1b4c/users/4c9b9b2d137447f2b83cd2cb3168ffc0/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:39.284908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.285191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.285461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.307630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f8e9b-51a1-43b7-a393-b6d0d1037129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.308658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8e9b-51a1-43b7-a393-b6d0d1037129 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.309163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8e9b-51a1-43b7-a393-b6d0d1037129 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.309578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8e9b-51a1-43b7-a393-b6d0d1037129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.319689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] MFA Rules not processed for user `0f5e52ab3f044e2e9123d984e4b5f8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:39.321035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:39.422476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f8e9b-51a1-43b7-a393-b6d0d1037129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.427348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f8e9b-51a1-43b7-a393-b6d0d1037129 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.453667 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1170/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:39.460488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.460616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.460890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.504429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1178/2348] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:39.518168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.521250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:39.525354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:39.532178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] MFA Rules not processed for user `4c9b9b2d137447f2b83cd2cb3168ffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:39.533506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:39.669837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10805406-d9f8-487c-9911-f862e66d83d4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.677482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.686921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.687267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.687574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.717055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1171/2349] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:39.720514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.722134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:39.732584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1179/2350] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:39.946180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:39.947958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:39.962779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd384-9acc-4dcb-b3c2-b435c64a90b7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:39.967648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e99988-7b9d-4ca9-a332-ef163de72e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:39.968261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99988-7b9d-4ca9-a332-ef163de72e9a service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:39.968603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99988-7b9d-4ca9-a332-ef163de72e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:39.969024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99988-7b9d-4ca9-a332-ef163de72e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:39.984328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e99988-7b9d-4ca9-a332-ef163de72e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:39.986267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e99988-7b9d-4ca9-a332-ef163de72e9a service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:40.000313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1172/2351] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:40.214034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:40.216666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:40.245042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:40.358500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7850-84c2-4051-b564-228d2f4d74ba service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:40.364238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:40.365014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:40.365288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:40.365792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] PATH_INFO: `/v3/users/b39b169266f34147a65be562f17f7464` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:40.368015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39b169266f34147a65be562f17f7464)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:40.372311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:40.491829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39b169266f34147a65be562f17f7464'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:40.492752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39b169266f34147a65be562f17f7464'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:40.520813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39b169266f34147a65be562f17f7464'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:40.545845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39b169266f34147a65be562f17f7464'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:40.550348 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39b169266f34147a65be562f17f7464'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:40.579210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1180/2352] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:40 2022] DELETE /identity/v3/users/b39b169266f34147a65be562f17f7464 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:40.580713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:40.581067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:40.581567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:40.614398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:40.615748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:40.726161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1173/2353] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:40.735999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:40.742740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:40.824401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db269356-ad31-46cc-8eae-2e88617009af admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:40.830991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ce28d-ac86-43f4-becc-270aad46967f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:40.831644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce28d-ac86-43f4-becc-270aad46967f service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:40.831920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce28d-ac86-43f4-becc-270aad46967f service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:40.832747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce28d-ac86-43f4-becc-270aad46967f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:40.845798 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ce28d-ac86-43f4-becc-270aad46967f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:40.847645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ce28d-ac86-43f4-becc-270aad46967f service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:40.862396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1181/2354] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:41.216430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:41.218446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:41.231852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb0623-1def-463a-be8a-149bfc3c9e6d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:41.249302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:41.250062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:41.251109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:41.251587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] PATH_INFO: `/v3/projects/e243bc8b930c4c8ca254fac4f5c502b9` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:41.253089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e243bc8b930c4c8ca254fac4f5c502b9)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:41.255737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:41.337831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e243bc8b930c4c8ca254fac4f5c502b9', 'request_id': 'req-dfefc186-86d2-4568-89d4-936003b03816'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:41.337831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e243bc8b930c4c8ca254fac4f5c502b9', 'request_id': 'req-dfefc186-86d2-4568-89d4-936003b03816'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:41.338824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e243bc8b930c4c8ca254fac4f5c502b9', 'request_id': 'req-dfefc186-86d2-4568-89d4-936003b03816'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:41.356067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] The token cache is being invalidate because project e243bc8b930c4c8ca254fac4f5c502b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:41.356410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:41.357084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:41.362991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1174/2355] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:41 2022] DELETE /identity/v3/projects/e243bc8b930c4c8ca254fac4f5c502b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:42.095156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b813e74-e3d1-4c80-9ef7-dd0a1ca1d48e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:42.095685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b813e74-e3d1-4c80-9ef7-dd0a1ca1d48e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:42.095790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b813e74-e3d1-4c80-9ef7-dd0a1ca1d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:42.131309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8b813e74-e3d1-4c80-9ef7-dd0a1ca1d48e None None] MFA Rules not processed for user `3c995c3fcae24fffb1a3a2147a9d6d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:42.132527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8b813e74-e3d1-4c80-9ef7-dd0a1ca1d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:42.213128 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:42.306248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1182/2356] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:43.635343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:43.636834 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:43.668710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:43.828557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc186-86d2-4568-89d4-936003b03816 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:43.839448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:43.840711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:43.841376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:43.841827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] PATH_INFO: `/v3/users/81b45e6bf66f4dbd8d123aa5c23791f0` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:43.843707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b45e6bf66f4dbd8d123aa5c23791f0)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:43.847657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:43.975372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b45e6bf66f4dbd8d123aa5c23791f0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:43.976526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b45e6bf66f4dbd8d123aa5c23791f0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:43.986896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b45e6bf66f4dbd8d123aa5c23791f0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:44.012265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b45e6bf66f4dbd8d123aa5c23791f0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:44.016858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b45e6bf66f4dbd8d123aa5c23791f0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:44.048950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1175/2357] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:43 2022] DELETE /identity/v3/users/81b45e6bf66f4dbd8d123aa5c23791f0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:44.050667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:44.051173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:44.051254 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:44.080177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:44.085178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:44.272115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1183/2358] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:44.318284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:44.320314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:44.435069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707ff77-5406-44c1-bcf3-89cb25fdec3b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:44.450290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a5d8c-4237-4753-ad4f-b20f6b186ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:44.451011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a5d8c-4237-4753-ad4f-b20f6b186ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:44.451295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a5d8c-4237-4753-ad4f-b20f6b186ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:44.451604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a5d8c-4237-4753-ad4f-b20f6b186ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:44.473826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a5d8c-4237-4753-ad4f-b20f6b186ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:44.476005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a5d8c-4237-4753-ad4f-b20f6b186ad6 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:44.489986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1176/2359] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:45.144363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.146277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:45.174593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e138-4da8-47e1-9b7b-1e0a3b02f271 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.179860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.180751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.181027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.181297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] PATH_INFO: `/v3/projects/412df48d7e474810b31b236574b27814` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.182428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=412df48d7e474810b31b236574b27814)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.184421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.231120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412df48d7e474810b31b236574b27814', 'request_id': 'req-250119b6-285c-4662-91aa-43aadfde6fab'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:45.236611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412df48d7e474810b31b236574b27814', 'request_id': 'req-250119b6-285c-4662-91aa-43aadfde6fab'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:45.245472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412df48d7e474810b31b236574b27814', 'request_id': 'req-250119b6-285c-4662-91aa-43aadfde6fab'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:45.258096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] The token cache is being invalidate because project 412df48d7e474810b31b236574b27814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:45.258387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:45.259122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-250119b6-285c-4662-91aa-43aadfde6fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:45.260682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1184/2360] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:45 2022] DELETE /identity/v3/projects/412df48d7e474810b31b236574b27814 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:45.267106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.267641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.267641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.289222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:45.290806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:45.328824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:45.366515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1177/2361] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:45.374628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.374991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.375338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.397204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:45.398606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:45.411853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1185/2362] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:45.417805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.434091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25c830-9d01-4e7b-93f7-7a08d3d827c5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.441189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.442969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.443388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.443800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.444778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:45.445251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.448029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.482916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.494863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1178/2363] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:45.498197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ebec-736b-47b0-a16c-4fbcc674fe04 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.504323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.505553 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.506670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.507440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.509054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.511281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.560898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1186/2364] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:45 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:45.562273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.574153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff301a-10c5-48ca-b675-eef15151c753 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.651437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.662716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.662716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.662716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.662716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.662716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.698915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1179/2365] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:45 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:45.700211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.717265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9028335-2b24-45b9-9a79-9833e0deb859 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.721957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.722573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.722878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.723145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.723874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.725370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.739402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1187/2366] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:49:45.740693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.756809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c130-9b70-452d-afb2-5ab7646ade95 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.762489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d879be-0e1f-4502-b1b7-9b3d7a834479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.763279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d879be-0e1f-4502-b1b7-9b3d7a834479 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.763554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d879be-0e1f-4502-b1b7-9b3d7a834479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.763819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d879be-0e1f-4502-b1b7-9b3d7a834479 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.764465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d879be-0e1f-4502-b1b7-9b3d7a834479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.766320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d879be-0e1f-4502-b1b7-9b3d7a834479 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.778564 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1180/2367] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:45.782521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.793306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a61a33-1fc4-4c72-b6f6-34f8e92ce456 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:45.798616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:45.799317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.799590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.799884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] PATH_INFO: `/v3/projects/955bf6f5c96a4f7bb8a8b5a3782fe88b/users/4ac85a80b918495297f5a40645cbea3b/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.816497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=955bf6f5c96a4f7bb8a8b5a3782fe88b, user_id=4ac85a80b918495297f5a40645cbea3b, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:45.820711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:45.833373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:45.840462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1188/2368] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:45 2022] PUT /identity/v3/projects/955bf6f5c96a4f7bb8a8b5a3782fe88b/users/4ac85a80b918495297f5a40645cbea3b/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:45.845631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718632-4690-4846-a20c-7ad9d56139e4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:45.846202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718632-4690-4846-a20c-7ad9d56139e4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:45.846542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718632-4690-4846-a20c-7ad9d56139e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:45.867590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f8718632-4690-4846-a20c-7ad9d56139e4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:45.868880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f8718632-4690-4846-a20c-7ad9d56139e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:45.926506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1181/2369] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:45.936522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:45.938615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:45.998048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e98a9b-4f0d-4aac-8989-4a2bb2445d8f admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:46.001923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:46.002527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:46.002854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:46.003093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:46.013440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:46.015793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:46.031347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1189/2370] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:46.805746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64f852-b92d-4b81-ae09-e1c86509e0b1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:46.806249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64f852-b92d-4b81-ae09-e1c86509e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:46.806347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64f852-b92d-4b81-ae09-e1c86509e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:46.838513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ab64f852-b92d-4b81-ae09-e1c86509e0b1 None None] MFA Rules not processed for user `4ac85a80b918495297f5a40645cbea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:46.840719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ab64f852-b92d-4b81-ae09-e1c86509e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:46.881370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:46.930856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1182/2371] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:46.941865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:46.943324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:47.104101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec880-2d44-487f-af5d-e7f61c13ced2 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:47.108448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:47.109250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:47.109733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:47.110012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:47.122314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:47.123923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:47.133731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1190/2372] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:48.503035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46b2c-16e9-419c-82f7-26c4cf259622 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:48.503687 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46b2c-16e9-419c-82f7-26c4cf259622 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:48.504059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46b2c-16e9-419c-82f7-26c4cf259622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:48.544743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ebc46b2c-16e9-419c-82f7-26c4cf259622 None None] MFA Rules not processed for user `4ac85a80b918495297f5a40645cbea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:48.546226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ebc46b2c-16e9-419c-82f7-26c4cf259622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:48.554528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1183/2373] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:51.728518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:51.730614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:51.752006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1547bf-9087-43f2-95c8-ab8cdaa873f5 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:51.757645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:51.758272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:51.758538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:51.758832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] PATH_INFO: `/v3/users/4c9b9b2d137447f2b83cd2cb3168ffc0` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:51.759985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9b9b2d137447f2b83cd2cb3168ffc0)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:51.761924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:51.810923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9b9b2d137447f2b83cd2cb3168ffc0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:51.811711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9b9b2d137447f2b83cd2cb3168ffc0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:51.819570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9b9b2d137447f2b83cd2cb3168ffc0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:51.833550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9b9b2d137447f2b83cd2cb3168ffc0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:51.834479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9b9b2d137447f2b83cd2cb3168ffc0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:51.848891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1191/2374] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:51 2022] DELETE /identity/v3/users/4c9b9b2d137447f2b83cd2cb3168ffc0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:51.853562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:51.854085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:51.854196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:51.874341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:51.876177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:51.963524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1184/2375] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:51.976260 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:51.977688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:52.003810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:52.054134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3660fa-6767-4ee7-bcec-d2bd0e310493 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:52.058287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d623af5-ea1c-4a23-ae55-ff067c4d2d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:52.059237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d623af5-ea1c-4a23-ae55-ff067c4d2d6b service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:52.059575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d623af5-ea1c-4a23-ae55-ff067c4d2d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:52.059957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d623af5-ea1c-4a23-ae55-ff067c4d2d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:52.072045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d623af5-ea1c-4a23-ae55-ff067c4d2d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:52.073590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d623af5-ea1c-4a23-ae55-ff067c4d2d6b service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:52.086497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1192/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:52.595487 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:52.597858 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:52.637456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1329c23-d1bb-4725-933c-10a56757db2d None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:52.652011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:52.652761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:52.653080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:52.653356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] PATH_INFO: `/v3/projects/ca463130ab6a4a33b0868791fa5e1b4c` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:52.654911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca463130ab6a4a33b0868791fa5e1b4c)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:52.658410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:52.718829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca463130ab6a4a33b0868791fa5e1b4c', 'request_id': 'req-e3e6fc33-0567-491e-8e6d-867a02eda1fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:52.722518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca463130ab6a4a33b0868791fa5e1b4c', 'request_id': 'req-e3e6fc33-0567-491e-8e6d-867a02eda1fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:52.729219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca463130ab6a4a33b0868791fa5e1b4c', 'request_id': 'req-e3e6fc33-0567-491e-8e6d-867a02eda1fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:52.742458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] The token cache is being invalidate because project ca463130ab6a4a33b0868791fa5e1b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:52.742775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:52.743386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e3e6fc33-0567-491e-8e6d-867a02eda1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:52.744887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1185/2377] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:52 2022] DELETE /identity/v3/projects/ca463130ab6a4a33b0868791fa5e1b4c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:02.081212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=18 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:02.739544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:05.985665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:05.986186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:05.986278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:06.006929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] MFA Rules not processed for user `9f808c9a93784ba39f6da88465fc46fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:06.008243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:06.065779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1193/2378] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:16.059009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=25 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:16.290065 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccd15-2460-458d-ab39-4be024c0f1c4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:16.290600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccd15-2460-458d-ab39-4be024c0f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:16.290600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccd15-2460-458d-ab39-4be024c0f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:16.310844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1eeccd15-2460-458d-ab39-4be024c0f1c4 None None] MFA Rules not processed for user `6f56d81c90714d7584d80cf3fb1d4075`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:16.312082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1eeccd15-2460-458d-ab39-4be024c0f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:16.373726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1186/2379] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:18.112564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:18.114112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:18.189875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ead9d-9fa9-4a41-b2c3-69f8445722d2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:18.194676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:18.195534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:18.195960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:18.196377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] PATH_INFO: `/v3/users/0f5e52ab3f044e2e9123d984e4b5f8c3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:18.197857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5e52ab3f044e2e9123d984e4b5f8c3)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:18.199975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:18.254531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5e52ab3f044e2e9123d984e4b5f8c3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:18.255232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5e52ab3f044e2e9123d984e4b5f8c3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:18.263605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5e52ab3f044e2e9123d984e4b5f8c3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:18.284638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5e52ab3f044e2e9123d984e4b5f8c3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:18.285741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5e52ab3f044e2e9123d984e4b5f8c3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:18.311889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1194/2380] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:50:18 2022] DELETE /identity/v3/users/0f5e52ab3f044e2e9123d984e4b5f8c3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:18.314385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:18.315132 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:18.315536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:18.366019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:18.368493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:18.508205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1187/2381] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:50:18.522789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:18.524826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:18.646815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7089-2e4d-40bc-b89d-41a418ac5413 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:18.650641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ad60d-c1ac-4d1a-9612-26ea7e07d5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:18.653144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad60d-c1ac-4d1a-9612-26ea7e07d5cc service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:18.653505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad60d-c1ac-4d1a-9612-26ea7e07d5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:18.653865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad60d-c1ac-4d1a-9612-26ea7e07d5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:18.670942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ad60d-c1ac-4d1a-9612-26ea7e07d5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:18.672784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ad60d-c1ac-4d1a-9612-26ea7e07d5cc service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:18.684140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1195/2382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:19.143131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.144691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:19.158972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581367d-5ab9-44dc-8c89-f58d3f7ceff7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.182362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.183693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.184621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.184992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] PATH_INFO: `/v3/projects/aed7ec45099543999e98f86417d82120` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.186232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed7ec45099543999e98f86417d82120)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.195972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.265760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed7ec45099543999e98f86417d82120', 'request_id': 'req-59bee3e0-64b3-474b-945f-7b1567dd6c08'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:19.272193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed7ec45099543999e98f86417d82120', 'request_id': 'req-59bee3e0-64b3-474b-945f-7b1567dd6c08'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:19.281204 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed7ec45099543999e98f86417d82120', 'request_id': 'req-59bee3e0-64b3-474b-945f-7b1567dd6c08'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:19.303799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] The token cache is being invalidate because project aed7ec45099543999e98f86417d82120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:50:19.304220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:19.305138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-59bee3e0-64b3-474b-945f-7b1567dd6c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:19.310888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1188/2383] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:50:19 2022] DELETE /identity/v3/projects/aed7ec45099543999e98f86417d82120 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:19.312402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.312823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.312975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.336448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:19.337389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:19.359051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:19.450808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1196/2384] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:19.456496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.457029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.457029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.486100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:19.487379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:19.497538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1189/2385] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:19.502633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.512845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7132e4-c9c7-4936-a937-4791c6924a22 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.517517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.518123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.518401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.518667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.519340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:50:19.519639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.521489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.543509 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1197/2386] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:50:19.547695 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.557148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dbef8-669e-4647-96b3-a18d0ba45345 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.562181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.562721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.563163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.563546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.564195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.566361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.599950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:19.612969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.614078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1190/2387] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:50:19 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:50:19.625071 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d6bd5-8bd2-4555-8ba2-38ea57739da0 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.705114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.705912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.706281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.706637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.707884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.709886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.752671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1198/2388] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:50:19 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:50:19.753210 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.777809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860247c7-ec38-4121-a913-43d7cb4a4299 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.782932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.783882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.784432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.784957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.785585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.787202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.798446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1191/2389] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:50:19.802951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.813885 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6317e-478c-4da1-b67f-ef48612777a4 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.818946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5df9f-1d15-4818-9b3b-265d0d366a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.819620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5df9f-1d15-4818-9b3b-265d0d366a0d admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.819899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5df9f-1d15-4818-9b3b-265d0d366a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.820173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5df9f-1d15-4818-9b3b-265d0d366a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.820853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5df9f-1d15-4818-9b3b-265d0d366a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.822465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5df9f-1d15-4818-9b3b-265d0d366a0d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.838146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1199/2390] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:50:19.839733 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.850866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe916bf-54a1-4232-b453-c76fed8f8e7c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.855949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.856619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.856896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.857278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] PATH_INFO: `/v3/projects/366d8430ecc544a29cc45b6282b890ca/users/842ef6d4d4d14a16b14e507e18fd5182/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.873236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366d8430ecc544a29cc45b6282b890ca, user_id=842ef6d4d4d14a16b14e507e18fd5182, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.876152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.892649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1192/2391] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:50:19 2022] PUT /identity/v3/projects/366d8430ecc544a29cc45b6282b890ca/users/842ef6d4d4d14a16b14e507e18fd5182/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:19.902970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.903339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.903717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.932367 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] MFA Rules not processed for user `842ef6d4d4d14a16b14e507e18fd5182`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:19.933595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:20.002859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1200/2392] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:20.014960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:20.016764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:20.080375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ea6ad-f1d6-4b23-b677-c5c966448c46 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:20.084828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3913-ea4f-4312-9930-b2af0051c20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:20.085566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3913-ea4f-4312-9930-b2af0051c20d service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:20.085893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3913-ea4f-4312-9930-b2af0051c20d service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:20.086225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3913-ea4f-4312-9930-b2af0051c20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:20.098252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3913-ea4f-4312-9930-b2af0051c20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:20.099741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3913-ea4f-4312-9930-b2af0051c20d service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:20.109870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1193/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:26.289943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:26.311731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:26.360926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878df8e-6a43-4fb8-9b75-6862a303926b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:26.366182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:26.366830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:26.367127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:26.367362 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] PATH_INFO: `/v3/users/842ef6d4d4d14a16b14e507e18fd5182` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:26.368482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842ef6d4d4d14a16b14e507e18fd5182)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:26.370403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:26.420372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842ef6d4d4d14a16b14e507e18fd5182'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:26.421204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842ef6d4d4d14a16b14e507e18fd5182'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:26.428298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842ef6d4d4d14a16b14e507e18fd5182'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:26.441965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842ef6d4d4d14a16b14e507e18fd5182'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:26.442870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842ef6d4d4d14a16b14e507e18fd5182'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:26.457044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1201/2394] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:50:26 2022] DELETE /identity/v3/users/842ef6d4d4d14a16b14e507e18fd5182 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:26.462173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:26.462668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:26.462801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:26.492189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:26.493608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:26.559490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1194/2395] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:26.569690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:26.571949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:26.630248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ae8e9-7f25-405c-aedd-717245de9379 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:26.634015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650fc0-302b-4b82-ba68-bec8aa691660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:26.634632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650fc0-302b-4b82-ba68-bec8aa691660 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:26.634950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650fc0-302b-4b82-ba68-bec8aa691660 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:26.635220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650fc0-302b-4b82-ba68-bec8aa691660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:26.644935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650fc0-302b-4b82-ba68-bec8aa691660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:26.646378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650fc0-302b-4b82-ba68-bec8aa691660 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:26.655891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1202/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:27.063449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:27.065058 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:27.080650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44576e27-34bd-492f-849a-cbb13eba9dcc None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:27.086812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:27.087422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:27.087714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:27.088053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] PATH_INFO: `/v3/projects/366d8430ecc544a29cc45b6282b890ca` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:27.089078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366d8430ecc544a29cc45b6282b890ca)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:27.091102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:27.139129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366d8430ecc544a29cc45b6282b890ca', 'request_id': 'req-52273976-27d3-4ea3-87b1-a4f055deb693'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:27.144536 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366d8430ecc544a29cc45b6282b890ca', 'request_id': 'req-52273976-27d3-4ea3-87b1-a4f055deb693'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:27.150601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366d8430ecc544a29cc45b6282b890ca', 'request_id': 'req-52273976-27d3-4ea3-87b1-a4f055deb693'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:27.152246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:27.165368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] The token cache is being invalidate because project 366d8430ecc544a29cc45b6282b890ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:50:27.165651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:27.166253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:27.167761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1195/2397] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:50:27 2022] DELETE /identity/v3/projects/366d8430ecc544a29cc45b6282b890ca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:50:35.683720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01490-01e7-48a9-ae8f-a87e92b6089e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:35.684226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01490-01e7-48a9-ae8f-a87e92b6089e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:35.684333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01490-01e7-48a9-ae8f-a87e92b6089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:35.705314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b1b01490-01e7-48a9-ae8f-a87e92b6089e None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:35.706790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b1b01490-01e7-48a9-ae8f-a87e92b6089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:35.758310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:35.788505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1203/2398] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:35.806871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:35.808774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:35.896040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273976-27d3-4ea3-87b1-a4f055deb693 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:35.901936 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:35.902568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:35.902881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:35.903156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:35.914012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:35.915427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:35.931379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1196/2399] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:37.746534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce602f-225e-417c-a191-98a40e3aaa46 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:37.747017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce602f-225e-417c-a191-98a40e3aaa46 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:37.747100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce602f-225e-417c-a191-98a40e3aaa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:37.772398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8dce602f-225e-417c-a191-98a40e3aaa46 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:37.773695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8dce602f-225e-417c-a191-98a40e3aaa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:37.831897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1204/2400] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:50:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:37.874070 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:37.875575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:37.944398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595e067-86b8-4c55-bb60-6f40c1151c8d service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:37.950512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:37.951164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:37.951437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:37.951792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:37.962566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:37.964219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:37.972769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1197/2401] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:50:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:50:39.910657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ed5a8-591b-4882-a66b-15a8123c5af2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:39.910657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ed5a8-591b-4882-a66b-15a8123c5af2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:39.910657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ed5a8-591b-4882-a66b-15a8123c5af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:39.931799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0e1ed5a8-591b-4882-a66b-15a8123c5af2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:39.933235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0e1ed5a8-591b-4882-a66b-15a8123c5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:39.943406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1205/2402] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:50:39.985965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:39.987439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:40.003368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5e09a-7e77-4af3-bb3d-4aa22b3e2adf service swift] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:40.009590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:40.010485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:40.010614 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:40.011123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:40.020844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:40.022660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:40.034728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1198/2403] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:44.185778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff6b4-91ba-48fa-beba-8dfa55d0a0c1 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:44.186575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff6b4-91ba-48fa-beba-8dfa55d0a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:44.186575 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff6b4-91ba-48fa-beba-8dfa55d0a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:44.210162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ae6ff6b4-91ba-48fa-beba-8dfa55d0a0c1 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:44.211817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ae6ff6b4-91ba-48fa-beba-8dfa55d0a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:44.222993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1206/2404] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:44.243650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:44.255911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138b73-03f2-4123-8f41-b940de3caf39 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:44.262188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:44.262841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:44.263125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:44.263558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:44.272659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:44.274201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:44.284419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1199/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:48.362331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a247-d71e-4bfc-9a54-9a50a1c2d0ef None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:48.363181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a247-d71e-4bfc-9a54-9a50a1c2d0ef None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:48.363181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a247-d71e-4bfc-9a54-9a50a1c2d0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:48.387704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8a15a247-d71e-4bfc-9a54-9a50a1c2d0ef None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:48.389280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8a15a247-d71e-4bfc-9a54-9a50a1c2d0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:48.398139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1207/2406] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:48.426317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:48.440163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8712-4f69-4a73-b908-5012ca39bd7e service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:48.447523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c578660-4cce-46fc-a9e8-4120ad1a7301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:48.448271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578660-4cce-46fc-a9e8-4120ad1a7301 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:48.448692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578660-4cce-46fc-a9e8-4120ad1a7301 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:48.449193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578660-4cce-46fc-a9e8-4120ad1a7301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:48.462675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c578660-4cce-46fc-a9e8-4120ad1a7301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:48.465946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c578660-4cce-46fc-a9e8-4120ad1a7301 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:48.491896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1200/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:52.053216 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:52.053764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:52.053764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:52.073795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] MFA Rules not processed for user `2c55486a82b54091ad04eaa32fdd3a36`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:52.075062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:52.137221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1208/2408] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:53.311304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af6327-3601-4d5f-8703-4b3cd67237e5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:53.311826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af6327-3601-4d5f-8703-4b3cd67237e5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:53.311982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af6327-3601-4d5f-8703-4b3cd67237e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:53.332892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-54af6327-3601-4d5f-8703-4b3cd67237e5 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:53.334307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-54af6327-3601-4d5f-8703-4b3cd67237e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:53.341922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1201/2409] 10.222.0.49 () {58 vars in 967 bytes} [Tue Sep 6 11:50:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:53.355752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:53.368504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c112ed-acde-482c-b542-beef0253eff8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:53.374857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:53.375474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:53.375751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:53.376020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:53.384454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:53.386045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:53.393953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1209/2410] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:50:53.651906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:53.652848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:53.653143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:53.675154 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:53.678490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:53.694145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1202/2411] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:53.725974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:53.738915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c20a-40f5-47cf-b4dc-7ceef7ace16f service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:53.750763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:53.751391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:53.751669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:53.756633 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:53.766334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:53.769529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:53.782064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1210/2412] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:55.482197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:55.483881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:55.496434 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ea6c-659a-440d-b56d-e3effb13c57c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:55.502500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:55.503193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:55.503476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:55.503740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] PATH_INFO: `/v3/users/9f808c9a93784ba39f6da88465fc46fc` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:55.504991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f808c9a93784ba39f6da88465fc46fc)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:55.506998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:55.513139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:55.559211 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f808c9a93784ba39f6da88465fc46fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.559998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f808c9a93784ba39f6da88465fc46fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.567425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f808c9a93784ba39f6da88465fc46fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.580466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f808c9a93784ba39f6da88465fc46fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.581257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-bc652124-7cee-4c9a-9889-b0187e8a8566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f808c9a93784ba39f6da88465fc46fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.595985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1203/2413] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:50:55 2022] DELETE /identity/v3/users/9f808c9a93784ba39f6da88465fc46fc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:55.795324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:55.806511 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5c2b-8155-46f5-bd56-76d24a90bbc0 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:55.851129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:55.867445 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:55.868076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:55.868351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:55.868621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] PATH_INFO: `/v3/projects/c1f9ea3020bd49658f56e7fcd44233a2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:55.869755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f9ea3020bd49658f56e7fcd44233a2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:55.871731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:55.920019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f9ea3020bd49658f56e7fcd44233a2', 'request_id': 'req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.925545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f9ea3020bd49658f56e7fcd44233a2', 'request_id': 'req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.932685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f9ea3020bd49658f56e7fcd44233a2', 'request_id': 'req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.943586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] The token cache is being invalidate because project c1f9ea3020bd49658f56e7fcd44233a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:50:55.943872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.944531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d01ae5bb-da27-4c7b-a2d9-27c291ab1ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:50:55.946003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1211/2414] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:50:55 2022] DELETE /identity/v3/projects/c1f9ea3020bd49658f56e7fcd44233a2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:55.951033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:55.951323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:55.951669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:55.972618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:55.973860 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:56.034350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1204/2415] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:56.042313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.042596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.042913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.063618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:56.064823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:56.075001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1212/2416] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:56.079374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.090018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc408a-c988-4bd2-bcca-0793f498913f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.096547 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.097247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.097530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.097804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.098460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:50:56.098803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.100407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.112659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1205/2417] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:50:56.118064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.127842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58424ff4-dd48-4705-a790-55f545c38ce2 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.132955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.133549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.133821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.134083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.135072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.137313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.166153 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1213/2418] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:50:56 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:50:56.170549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.184452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8275da-5f20-4032-86ae-5686ea312af6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.250560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.251327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.251705 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.252063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.252774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.254905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.276323 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1206/2419] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:50:56 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:50:56.280604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.291510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4242910-9162-4062-af31-f0783ccf11ac admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.296482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.297080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.297357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.297651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.298330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.300092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.310346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1214/2420] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:50:56.315176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.320891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:56.327397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f3054-f8f2-4103-ae87-4acd3e359ad9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.334876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bf01b-8a5e-4a70-bd8b-9db0f1fbfd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.335509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bf01b-8a5e-4a70-bd8b-9db0f1fbfd47 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.335841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bf01b-8a5e-4a70-bd8b-9db0f1fbfd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.336124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bf01b-8a5e-4a70-bd8b-9db0f1fbfd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.336784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bf01b-8a5e-4a70-bd8b-9db0f1fbfd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.339356 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bf01b-8a5e-4a70-bd8b-9db0f1fbfd47 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.353759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1207/2421] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:50:56.355027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.365372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d63a-43d9-45db-9248-4c8f35fa92fe admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.370257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.370956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.371235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.371510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] PATH_INFO: `/v3/projects/b004b047c0bf4f1b96be7f37b390ff30/users/9b4a6a141b2b4f73ba933f38d10283bb/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.388651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b004b047c0bf4f1b96be7f37b390ff30, user_id=9b4a6a141b2b4f73ba933f38d10283bb, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.391815 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.420757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1215/2422] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:50:56 2022] PUT /identity/v3/projects/b004b047c0bf4f1b96be7f37b390ff30/users/9b4a6a141b2b4f73ba933f38d10283bb/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:50:56.491677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adca35-2de0-4fa6-a2e2-fb6f11611480 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.492198 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adca35-2de0-4fa6-a2e2-fb6f11611480 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.492330 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adca35-2de0-4fa6-a2e2-fb6f11611480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.521586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d2adca35-2de0-4fa6-a2e2-fb6f11611480 None None] MFA Rules not processed for user `9b4a6a141b2b4f73ba933f38d10283bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:56.523082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d2adca35-2de0-4fa6-a2e2-fb6f11611480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:56.589053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1208/2423] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:50:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:56.600489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:56.602346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:56.686880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5108c-6fb6-401b-a169-40a26efb5725 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:56.690700 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:56.691448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:56.692019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:56.692132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:56.697877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:56.703030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:56.704632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:56.718555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1216/2424] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:57.859053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f9ed-3296-4155-b8f2-b333b4ccd910 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:57.859637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f9ed-3296-4155-b8f2-b333b4ccd910 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:57.859905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f9ed-3296-4155-b8f2-b333b4ccd910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:57.883941 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-46c6f9ed-3296-4155-b8f2-b333b4ccd910 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:57.885405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-46c6f9ed-3296-4155-b8f2-b333b4ccd910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:57.949043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1209/2425] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:57.969043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:57.970530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:58.050286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9bd7f-5944-4dac-8804-e67c2dcda92f service glance] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:58.059704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:58.060341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:58.060604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:58.060919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:58.070014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:58.071670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:58.082831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1217/2426] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:07.940691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=63 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:08.077857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=37 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:21.761446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:21.762006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:21.762006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:21.782161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] MFA Rules not processed for user `4ac85a80b918495297f5a40645cbea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:21.783474 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:21.842466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1210/2427] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:51:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:22.937438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:22.939060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:23.013274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63228c-7dc6-4a01-8224-9b0c162ed6a9 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:23.018952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:23.019554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:23.019852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:23.020110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:23.022070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:23.033933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:23.035578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb5a4e-0740-4507-bb65-d78ec086f5b3 service placement] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:23.045686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1218/2428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:25.923344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:25.935116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cacf4-fbcc-40a3-8deb-05bc6a5fa6b5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:25.941007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:25.941711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:25.941991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:25.942262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] PATH_INFO: `/v3/users/9b4a6a141b2b4f73ba933f38d10283bb` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:25.943550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4a6a141b2b4f73ba933f38d10283bb)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:25.945499 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:25.999073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4a6a141b2b4f73ba933f38d10283bb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:25.999725 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4a6a141b2b4f73ba933f38d10283bb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.006863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4a6a141b2b4f73ba933f38d10283bb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.020195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4a6a141b2b4f73ba933f38d10283bb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.020886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4a6a141b2b4f73ba933f38d10283bb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.034387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1211/2429] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:51:25 2022] DELETE /identity/v3/users/9b4a6a141b2b4f73ba933f38d10283bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:51:26.039065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:26.039601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:26.039715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:26.062192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:26.063441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:26.123376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1219/2430] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:51:26.133046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:26.134639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:26.199160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b65f2d-42c6-4750-86c2-41d3b1a37a1d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:26.202672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ac15-6818-4c71-960c-f72101da17cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:26.203332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ac15-6818-4c71-960c-f72101da17cf service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:26.203591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ac15-6818-4c71-960c-f72101da17cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:26.203874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ac15-6818-4c71-960c-f72101da17cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:26.213170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ac15-6818-4c71-960c-f72101da17cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:26.214622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ac15-6818-4c71-960c-f72101da17cf service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:26.223746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1212/2431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:26.519699 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:26.521306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:26.534123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143dcd-e088-480e-be9f-a4779f2756ca None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:26.540552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:26.541200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:26.542318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:26.542318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] PATH_INFO: `/v3/projects/b004b047c0bf4f1b96be7f37b390ff30` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:26.542958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b004b047c0bf4f1b96be7f37b390ff30)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:26.545030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:26.593579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b004b047c0bf4f1b96be7f37b390ff30', 'request_id': 'req-baa65e5f-3fcc-4262-aeed-d5642df8b26b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.599162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b004b047c0bf4f1b96be7f37b390ff30', 'request_id': 'req-baa65e5f-3fcc-4262-aeed-d5642df8b26b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.607902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b004b047c0bf4f1b96be7f37b390ff30', 'request_id': 'req-baa65e5f-3fcc-4262-aeed-d5642df8b26b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.622601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] The token cache is being invalidate because project b004b047c0bf4f1b96be7f37b390ff30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:51:26.622920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.623545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:26.625049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1220/2432] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:51:26 2022] DELETE /identity/v3/projects/b004b047c0bf4f1b96be7f37b390ff30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:51:36.219813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:36.619793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:37.307039 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbf61a-4b83-4e60-af2c-e37b2a4eb5c5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:37.307628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbf61a-4b83-4e60-af2c-e37b2a4eb5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:37.307628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbf61a-4b83-4e60-af2c-e37b2a4eb5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:37.328617 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ccbbf61a-4b83-4e60-af2c-e37b2a4eb5c5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:37.329843 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ccbbf61a-4b83-4e60-af2c-e37b2a4eb5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:37.395236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1213/2433] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:37.430659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:37.432239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:37.510481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65e5f-3fcc-4262-aeed-d5642df8b26b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:37.516735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:37.517341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:37.517618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:37.517887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:37.526244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:37.528119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:37.538134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1221/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:41.646060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a90f50-9ad4-41e8-bfc7-b16faa266c89 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:41.646650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a90f50-9ad4-41e8-bfc7-b16faa266c89 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:41.646650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a90f50-9ad4-41e8-bfc7-b16faa266c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:41.667613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c0a90f50-9ad4-41e8-bfc7-b16faa266c89 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:41.668828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c0a90f50-9ad4-41e8-bfc7-b16faa266c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:41.677426 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1214/2435] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:41.697006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:41.698654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:41.715013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd06ef-c428-499f-84df-dcef6add6411 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:41.722255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:41.722893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:41.723173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:41.723442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:41.732386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:41.733999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:41.744297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1222/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:45.967102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1c901-2ab0-43c9-a97a-85320bb0fcb6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:45.967966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1c901-2ab0-43c9-a97a-85320bb0fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:45.967966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1c901-2ab0-43c9-a97a-85320bb0fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:46.000889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4ad1c901-2ab0-43c9-a97a-85320bb0fcb6 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:46.002123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4ad1c901-2ab0-43c9-a97a-85320bb0fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:46.011207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1215/2437] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:46.036117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:46.048085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cece8-1678-4848-9cd4-d6cc082bb4fe service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:46.054944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:46.055473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:46.055749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:46.056018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:46.064963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:46.066559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:46.076741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1223/2438] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:50.167937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312adcd-79d5-467e-828d-e7fbd5d7e3e9 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:50.168473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312adcd-79d5-467e-828d-e7fbd5d7e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:50.168473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312adcd-79d5-467e-828d-e7fbd5d7e3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:50.189585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2312adcd-79d5-467e-828d-e7fbd5d7e3e9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:50.190847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2312adcd-79d5-467e-828d-e7fbd5d7e3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:50.199417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1216/2439] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:50.220584 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:50.232756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97660861-b57c-4385-a8a8-0ad88420739c service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:50.240072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:50.240666 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:50.241024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:50.241297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:50.250139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:50.251766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:50.261733 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1224/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:54.379156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bde9-04d6-4bb5-b762-9150d54810ac None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:54.379696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bde9-04d6-4bb5-b762-9150d54810ac None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:54.379696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bde9-04d6-4bb5-b762-9150d54810ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:54.404153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e6e8bde9-04d6-4bb5-b762-9150d54810ac None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:54.405841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e6e8bde9-04d6-4bb5-b762-9150d54810ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:54.414992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1217/2441] 10.222.0.52 () {58 vars in 1016 bytes} [Tue Sep 6 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:54.434674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:54.445802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461b4de-fdfa-4517-a8e2-a7226faf51aa service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:54.452753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:54.453347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:54.453623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:54.453892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:54.463462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:54.465059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:54.478072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1225/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:52:04.396643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=39 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:04.470744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=58 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:13.799352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883caa07-eaeb-42b4-9748-66deca9ff25e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:13.799863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883caa07-eaeb-42b4-9748-66deca9ff25e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:13.799958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883caa07-eaeb-42b4-9748-66deca9ff25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:13.819584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-883caa07-eaeb-42b4-9748-66deca9ff25e None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:13.820786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-883caa07-eaeb-42b4-9748-66deca9ff25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:13.878891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1218/2443] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:52:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:13.942756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:13.944410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:14.016308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f22ba-7ddb-4363-9e9e-96d4a91bf52f service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:14.022747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:14.023387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:14.023663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:14.024056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:14.032614 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:14.034237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:14.043513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1226/2444] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:23.871722 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=25 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:24.041006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=32 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:24.525069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48995567-746d-4038-86ae-69caeab59c85 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:24.525355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48995567-746d-4038-86ae-69caeab59c85 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:24.525631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48995567-746d-4038-86ae-69caeab59c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:24.546590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-48995567-746d-4038-86ae-69caeab59c85 None None] MFA Rules not processed for user `6f56d81c90714d7584d80cf3fb1d4075`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:24.547763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-48995567-746d-4038-86ae-69caeab59c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:24.611137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1219/2445] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:27.648033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:27.650090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:27.664679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb1a3b-b06f-4ac5-a6d7-b2414354ae42 service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:27.672009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:27.672718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:27.673096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:27.673450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] PATH_INFO: `/v3/users/4ac85a80b918495297f5a40645cbea3b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:27.674628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac85a80b918495297f5a40645cbea3b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:27.676824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:27.734475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac85a80b918495297f5a40645cbea3b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:27.735419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac85a80b918495297f5a40645cbea3b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:27.742868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac85a80b918495297f5a40645cbea3b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:27.756777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac85a80b918495297f5a40645cbea3b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:27.757563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-81bd987f-4637-4c84-bfd9-cf403b399e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac85a80b918495297f5a40645cbea3b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:27.771410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1227/2446] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:52:27 2022] DELETE /identity/v3/users/4ac85a80b918495297f5a40645cbea3b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:52:27.957105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48995567-746d-4038-86ae-69caeab59c85 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:27.974388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48995567-746d-4038-86ae-69caeab59c85 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:28.044071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:28.044927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:28.045296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:28.045621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] PATH_INFO: `/v3/projects/955bf6f5c96a4f7bb8a8b5a3782fe88b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:28.047545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955bf6f5c96a4f7bb8a8b5a3782fe88b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:28.050431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:28.106162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955bf6f5c96a4f7bb8a8b5a3782fe88b', 'request_id': 'req-33de72c7-dce6-44b5-9065-f401b7ab9fd7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:28.112098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955bf6f5c96a4f7bb8a8b5a3782fe88b', 'request_id': 'req-33de72c7-dce6-44b5-9065-f401b7ab9fd7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:28.118609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955bf6f5c96a4f7bb8a8b5a3782fe88b', 'request_id': 'req-33de72c7-dce6-44b5-9065-f401b7ab9fd7'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:28.133647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] The token cache is being invalidate because project 955bf6f5c96a4f7bb8a8b5a3782fe88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:52:28.133931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:28.134575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-33de72c7-dce6-44b5-9065-f401b7ab9fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:52:28.136123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1220/2447] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:52:27 2022] DELETE /identity/v3/projects/955bf6f5c96a4f7bb8a8b5a3782fe88b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:52:29.070055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab10e4-5776-4b6b-86cb-4ae6ec6a0c69 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.070643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab10e4-5776-4b6b-86cb-4ae6ec6a0c69 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.070643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab10e4-5776-4b6b-86cb-4ae6ec6a0c69 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.072014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1228/2448] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:52:29.078391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3474-459c-4e7b-b113-6b6202964314 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.078901 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3474-459c-4e7b-b113-6b6202964314 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.078997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3474-459c-4e7b-b113-6b6202964314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.107174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-acfd3474-459c-4e7b-b113-6b6202964314 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:29.108432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-acfd3474-459c-4e7b-b113-6b6202964314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:29.142113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:29.191225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1221/2449] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:29.203406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab10e4-5776-4b6b-86cb-4ae6ec6a0c69 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:29.205129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-69ab10e4-5776-4b6b-86cb-4ae6ec6a0c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:29.264299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab10e4-5776-4b6b-86cb-4ae6ec6a0c69 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:29.267874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb0a71-d4fc-4f02-804d-4c0d37d299c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:29.268475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a71-d4fc-4f02-804d-4c0d37d299c1 service glance] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.268755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a71-d4fc-4f02-804d-4c0d37d299c1 service glance] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.269008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a71-d4fc-4f02-804d-4c0d37d299c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.278954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb0a71-d4fc-4f02-804d-4c0d37d299c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:29.280383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb0a71-d4fc-4f02-804d-4c0d37d299c1 service glance] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:29.290840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1229/2450] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:52:29.368113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f5c7d-7588-4d0e-b348-f8b0dca72f50 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.368402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f5c7d-7588-4d0e-b348-f8b0dca72f50 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.368677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f5c7d-7588-4d0e-b348-f8b0dca72f50 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.370035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1222/2451] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:52:29.374967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2c73-4265-4074-adeb-bdab1135286a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.375283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2c73-4265-4074-adeb-bdab1135286a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.375558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2c73-4265-4074-adeb-bdab1135286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.396916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bd8d2c73-4265-4074-adeb-bdab1135286a None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:29.398050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bd8d2c73-4265-4074-adeb-bdab1135286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:29.463246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1230/2452] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:52:29.478931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f5c7d-7588-4d0e-b348-f8b0dca72f50 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:29.482165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-658f5c7d-7588-4d0e-b348-f8b0dca72f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:29.503117 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f5c7d-7588-4d0e-b348-f8b0dca72f50 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:29.507217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3355-45e7-404e-a43b-d230c2a3ecda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:29.507824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3355-45e7-404e-a43b-d230c2a3ecda service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.508107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3355-45e7-404e-a43b-d230c2a3ecda service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.508374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3355-45e7-404e-a43b-d230c2a3ecda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.516010 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3355-45e7-404e-a43b-d230c2a3ecda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:29.517460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3355-45e7-404e-a43b-d230c2a3ecda service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:29.525163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1223/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:52:29.615810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250fa69-234d-4e09-995e-2f8b61e4b7a0 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.616098 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250fa69-234d-4e09-995e-2f8b61e4b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.616373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250fa69-234d-4e09-995e-2f8b61e4b7a0 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.617741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1231/2454] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:52:29.623472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8151-fb60-43a8-88e9-e34cfcd148b7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.623758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8151-fb60-43a8-88e9-e34cfcd148b7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.624049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8151-fb60-43a8-88e9-e34cfcd148b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.646402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-08eb8151-fb60-43a8-88e9-e34cfcd148b7 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:29.647724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-08eb8151-fb60-43a8-88e9-e34cfcd148b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:29.658794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1224/2455] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:29.669482 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250fa69-234d-4e09-995e-2f8b61e4b7a0 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:29.681753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250fa69-234d-4e09-995e-2f8b61e4b7a0 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:29.685818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:29.686425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:29.686714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:29.686996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:29.698029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:29.699531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:29.711773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1232/2456] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:52:33.352748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c251110-dcfd-4e7c-960b-2e451fe4b694 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:33.353214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c251110-dcfd-4e7c-960b-2e451fe4b694 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:33.353299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c251110-dcfd-4e7c-960b-2e451fe4b694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:33.373759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3c251110-dcfd-4e7c-960b-2e451fe4b694 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:33.375012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3c251110-dcfd-4e7c-960b-2e451fe4b694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:33.441999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1225/2457] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:52:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:33.454479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:33.456158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:33.471122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:33.529074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ccbdf-3741-43f2-920b-0e9e8adff626 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:33.534929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:33.535540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:33.535829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:33.536123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:33.544435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:33.546053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:33.553990 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1233/2458] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:52:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:43.433578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=49 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:43.551109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=27 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:54.280710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5f54-a614-4140-be33-87df7ad0a55c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:54.281279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5f54-a614-4140-be33-87df7ad0a55c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:54.281279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5f54-a614-4140-be33-87df7ad0a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:54.304173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-9d8b5f54-a614-4140-be33-87df7ad0a55c None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:54.305502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9d8b5f54-a614-4140-be33-87df7ad0a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:54.315239 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1226/2459] 10.222.0.49 () {58 vars in 967 bytes} [Tue Sep 6 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:54.330528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:54.343663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192c7bf-1da6-4daf-a7d8-464366e08e42 service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:54.349869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:54.350547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:54.350921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:54.351343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:54.360893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:54.362500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:54.371317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1234/2460] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:53:04.297185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:04.367957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=6 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:04.790355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:04.790672 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:04.790981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:04.814226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] MFA Rules not processed for user `2c55486a82b54091ad04eaa32fdd3a36`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:53:04.815490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:04.875024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1227/2461] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:53:14.867842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=25 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:16.203638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:16.205232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:16.219129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40722-f271-4ec8-9315-f309fa220081 service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:16.223659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:16.224255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:16.224566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:16.224837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:16.226613 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:16.241116 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:16.242546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:16.253762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1235/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:26.248865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=6 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:36.618607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:36.620291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:36.687137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2c47-476f-476f-8c81-b43397f1905b None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:36.691201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:36.691833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:36.692116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:36.692389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:36.694315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:36.759248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:36.761232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:36.773513 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1228/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:39.617889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:39.626728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358291-3016-42e9-8b4b-40fe0d756989 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:39.630805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:39.631397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:39.631668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:39.631934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:39.634077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:39.648456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:39.649880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:39.661419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1236/2464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:46.768397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=48 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:49.656149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=6 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:50.591489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:50.594028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:50.611731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a264-6a5a-498f-b6bd-df8d15c54e6e service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:50.619769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:50.620130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:50.620491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:50.621080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:50.622905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:50.636659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:50.638626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:50.652310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1229/2465] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:57.035433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:57.044866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c2213-e576-4123-9f58-ca3b61e44336 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:57.049209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:57.049805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:57.050083 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:57.050345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:57.052523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:57.122043 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:57.123512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:57.134133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1237/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:00.179334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.180774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:00.205850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e67fc-9203-4f02-8d14-9b64c3977586 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.210852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.211482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.211757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.212072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] PATH_INFO: `/v3/users/6f56d81c90714d7584d80cf3fb1d4075` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.213214 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f56d81c90714d7584d80cf3fb1d4075)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.215207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:00.263788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f56d81c90714d7584d80cf3fb1d4075'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.264508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f56d81c90714d7584d80cf3fb1d4075'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.271414 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f56d81c90714d7584d80cf3fb1d4075'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.284107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f56d81c90714d7584d80cf3fb1d4075'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.284839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-35b2d7f9-bb0e-4d89-b5bf-103db6cc581e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f56d81c90714d7584d80cf3fb1d4075'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.298621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1230/2467] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:54:00 2022] DELETE /identity/v3/users/6f56d81c90714d7584d80cf3fb1d4075 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:54:00.477747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.493450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633993-7263-4b08-be77-21dd202e6146 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.546710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.547480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.547763 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.548048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] PATH_INFO: `/v3/projects/f6d17390167b4b2f878b6c18fe0cdddb` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.549196 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d17390167b4b2f878b6c18fe0cdddb)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.551143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:00.599205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d17390167b4b2f878b6c18fe0cdddb', 'request_id': 'req-d370951d-6c5c-40ab-b050-2acbedd45faf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.605456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d17390167b4b2f878b6c18fe0cdddb', 'request_id': 'req-d370951d-6c5c-40ab-b050-2acbedd45faf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.613684 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d17390167b4b2f878b6c18fe0cdddb', 'request_id': 'req-d370951d-6c5c-40ab-b050-2acbedd45faf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.626607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] The token cache is being invalidate because project f6d17390167b4b2f878b6c18fe0cdddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:54:00.627026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.627618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d370951d-6c5c-40ab-b050-2acbedd45faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:54:00.629288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1238/2468] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:54:00 2022] DELETE /identity/v3/projects/f6d17390167b4b2f878b6c18fe0cdddb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:54:00.634429 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.634735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.635043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.656596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:00.658521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:00.720644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1231/2469] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:54:00.728493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.728824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.729119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.749876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:00.751223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:00.760397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1239/2470] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:54:00.767218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.782497 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a57d4c-9d59-401c-a7a2-754521744c89 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.790632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.791599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.791876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.792142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.792820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:54:00.793105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.794726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:00.806574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1232/2471] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:54:00.811183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.821184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9393ef-713f-4560-886c-b98ca9001325 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.827223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.827831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.828109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.828381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.829035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.830973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:00.848024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:00.864319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1240/2472] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:54:00 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:54:00.868538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.878895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a5eb-56b0-4cfd-952e-47b6f443bc66 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.923937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:00.941370 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.941989 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.942269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.942538 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.943224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.945185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:00.967972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1233/2473] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:54:00 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:54:00.972233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.983183 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64251a-2a87-4847-a466-24ea50e29fad admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.988328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.988923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.989199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.989468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.990220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.991896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:01.002252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1241/2474] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:54:01.006675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:01.020162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb32d8-de94-4f3f-9c42-c95df429a401 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:01.024915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf6939-f912-482c-89de-ea77a904a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:01.025680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6939-f912-482c-89de-ea77a904a0ab admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:01.026022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6939-f912-482c-89de-ea77a904a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:01.026358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6939-f912-482c-89de-ea77a904a0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:01.027126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf6939-f912-482c-89de-ea77a904a0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:01.028799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf6939-f912-482c-89de-ea77a904a0ab admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:01.043463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1234/2475] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:54:01.044577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:01.054667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd9e4-2501-4721-8228-dbc38b6617ec admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:01.060075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:01.060864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:01.061209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:01.061567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] PATH_INFO: `/v3/projects/219852ae38654e9192e7cf61784825c2/users/fb794bb0f8984d218197d81eded1e5cf/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:01.077172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219852ae38654e9192e7cf61784825c2, user_id=fb794bb0f8984d218197d81eded1e5cf, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:01.079923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:01.094963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1242/2476] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:54:01 2022] PUT /identity/v3/projects/219852ae38654e9192e7cf61784825c2/users/fb794bb0f8984d218197d81eded1e5cf/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:54:01.100737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0afa6-dfa0-4533-a892-d34aeb877009 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:01.101055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0afa6-dfa0-4533-a892-d34aeb877009 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:01.101354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0afa6-dfa0-4533-a892-d34aeb877009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:01.122442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b5c0afa6-dfa0-4533-a892-d34aeb877009 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:01.123818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b5c0afa6-dfa0-4533-a892-d34aeb877009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:01.190916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1235/2477] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:54:01.201512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:01.203257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:01.262174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb06574-7d82-4583-bbfd-30bf9e40fb11 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:01.266106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:01.266720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:01.267028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:01.267294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:01.276571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:01.278021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:01.287471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1243/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:06.456233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1822e-ea34-4cf7-aa0b-3d69aacf7ced None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:06.456777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1822e-ea34-4cf7-aa0b-3d69aacf7ced None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:06.456777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1822e-ea34-4cf7-aa0b-3d69aacf7ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:06.491160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-0cb1822e-ea34-4cf7-aa0b-3d69aacf7ced None None] MFA Rules not processed for user `fb794bb0f8984d218197d81eded1e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:06.492598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0cb1822e-ea34-4cf7-aa0b-3d69aacf7ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:06.593714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1236/2479] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:54:06.608142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:06.609598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:06.692875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e58ef-aae3-462f-985c-0680624ffaf0 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:06.699939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443bd09-0c0c-4d43-9e63-c929ad276ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:06.700580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443bd09-0c0c-4d43-9e63-c929ad276ce8 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:06.700852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443bd09-0c0c-4d43-9e63-c929ad276ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:06.701315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443bd09-0c0c-4d43-9e63-c929ad276ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:06.713757 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443bd09-0c0c-4d43-9e63-c929ad276ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:06.715601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443bd09-0c0c-4d43-9e63-c929ad276ce8 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:06.725556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1244/2480] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:08.604434 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:08.605359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:08.605847 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:08.626130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] MFA Rules not processed for user `fb794bb0f8984d218197d81eded1e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:08.627470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:08.641659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1237/2481] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:54:09.082343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:09.083238 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:09.083662 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:09.118406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] MFA Rules not processed for user `3c995c3fcae24fffb1a3a2147a9d6d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:09.119728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:09.175932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:09.177147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:09.191852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e6fa0-a573-4a83-8ce5-3feab6a5f4d6 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:09.194939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1245/2482] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:54:09.195932 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:09.196561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:09.197082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:09.197634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:09.201548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:09.213338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:09.214828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:09.224580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1238/2483] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:09.657504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:09.669502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fcc29-9f1d-457d-a060-44e99688386b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:09.674897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:09.675974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:09.676402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:09.676860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:09.680120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:09.699263 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:09.700690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:09.702532 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:09.704195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:09.747831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1246/2484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:09.805044 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:09.856808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ff949-eeeb-499d-b068-5c26ee110045 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:09.868091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:09.869079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:09.869577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:09.870006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:09.876708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:09.890004 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:09.891653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:09.904328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1239/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:54:12.671945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:12.674483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:12.687182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c4f5-6fb2-4562-beb4-b7e852d87553 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:12.692215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:12.692963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:12.693337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:12.693681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:12.696150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:12.709619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:12.711148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:12.721400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1247/2486] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:19.899248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=16 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:20.531258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:20.532665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:20.553865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d9974-6f95-4aab-9b60-be3950d8bc8d service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:20.560382 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:20.561230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:20.561603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:20.561962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:20.563957 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:20.579145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:20.581059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:20.594678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1240/2487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:22.716442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=15 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:26.567198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:26.580664 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6979a-8a96-4195-a235-8ff6c049b202 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:26.587382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:26.588066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:26.588403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:26.588734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:26.590655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:26.603667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:26.605284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6385da9-6632-4d62-b06c-3ea1ac408349 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:26.615826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1248/2488] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:30.588920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=6 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:32.537393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:32.551165 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28ee0c-11ca-428a-8276-741ff5c53482 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:32.561329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:32.562134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:32.562442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:32.562818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:32.565718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:32.638615 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:32.640285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:32.650417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1241/2489] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:36.611290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=6 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:42.645870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=28 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:44.907277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a061a-af92-49b3-a9a2-ab7482c9239c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:44.907830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a061a-af92-49b3-a9a2-ab7482c9239c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:44.907830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a061a-af92-49b3-a9a2-ab7482c9239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:44.928134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-004a061a-af92-49b3-a9a2-ab7482c9239c None None] MFA Rules not processed for user `2c55486a82b54091ad04eaa32fdd3a36`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:44.929360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-004a061a-af92-49b3-a9a2-ab7482c9239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:44.937310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1249/2490] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:54:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:54:54.922944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:41.496990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:55:41.512788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ec83-bd94-4940-9ffe-d4eaff0d3b33 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:55:41.519788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:55:41.520396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:55:41.520665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:55:41.520929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:55:41.522949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:55:41.533559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:55:41.535196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:55:41.544256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1242/2491] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:55:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:55:51.540089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=6 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:02.276796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a102f-efc0-47df-86f4-26031ec0f358 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:02.277343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a102f-efc0-47df-86f4-26031ec0f358 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:02.277343 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a102f-efc0-47df-86f4-26031ec0f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:02.297705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-071a102f-efc0-47df-86f4-26031ec0f358 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:02.299007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-071a102f-efc0-47df-86f4-26031ec0f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:02.364805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1250/2492] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:56:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:02.415806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:02.417735 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:02.491099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcdaa8-c9a7-40f3-a08c-de565e80f77c service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:02.496482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaa831-c44c-42b9-9818-0d9e78ced073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:02.497123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaa831-c44c-42b9-9818-0d9e78ced073 service swift] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:02.497387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaa831-c44c-42b9-9818-0d9e78ced073 service swift] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:02.497662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaa831-c44c-42b9-9818-0d9e78ced073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:02.506103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eaa831-c44c-42b9-9818-0d9e78ced073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:02.507745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eaa831-c44c-42b9-9818-0d9e78ced073 service swift] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:02.516911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1243/2493] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:56:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:56:12.357469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=25 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:12.513652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=32 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:16.181770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f208477-91f1-489a-a724-0ae655ce6d21 None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.182443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f208477-91f1-489a-a724-0ae655ce6d21 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.182443 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f208477-91f1-489a-a724-0ae655ce6d21 None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.184437 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1251/2494] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:56:16.190531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d541e5-3331-4d64-93ce-66e093df3217 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.191133 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d541e5-3331-4d64-93ce-66e093df3217 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.191253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d541e5-3331-4d64-93ce-66e093df3217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.266996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-57d541e5-3331-4d64-93ce-66e093df3217 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:16.268534 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-57d541e5-3331-4d64-93ce-66e093df3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:16.340316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1244/2495] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:56:16.351694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f208477-91f1-489a-a724-0ae655ce6d21 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:16.353379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2f208477-91f1-489a-a724-0ae655ce6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:16.411893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f208477-91f1-489a-a724-0ae655ce6d21 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:16.416223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439dd20-98f9-4370-9192-95a261c4bae6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:16.416796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dd20-98f9-4370-9192-95a261c4bae6 service glance] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.417066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dd20-98f9-4370-9192-95a261c4bae6 service glance] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.417329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dd20-98f9-4370-9192-95a261c4bae6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.428245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439dd20-98f9-4370-9192-95a261c4bae6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:16.429676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439dd20-98f9-4370-9192-95a261c4bae6 service glance] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:16.440694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1252/2496] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:16.525219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571093a2-d7de-4f66-bbfb-2fc112bb95e3 None None] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.525506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571093a2-d7de-4f66-bbfb-2fc112bb95e3 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.525777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571093a2-d7de-4f66-bbfb-2fc112bb95e3 None None] PATH_INFO: `/` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.527177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1245/2497] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:56:16.532109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead8ef-09fb-4a78-9121-fa14f9605617 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.532426 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead8ef-09fb-4a78-9121-fa14f9605617 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.532698 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead8ef-09fb-4a78-9121-fa14f9605617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.553445 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b0ead8ef-09fb-4a78-9121-fa14f9605617 None None] MFA Rules not processed for user `ac866c0c1c33423b9ecbf97a3b08240c`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:16.554595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b0ead8ef-09fb-4a78-9121-fa14f9605617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:16.561341 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1253/2498] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:16.573033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571093a2-d7de-4f66-bbfb-2fc112bb95e3 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:16.584046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571093a2-d7de-4f66-bbfb-2fc112bb95e3 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:16.588442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05cf2-bd75-4013-899b-6b41323a3929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:16.589030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05cf2-bd75-4013-899b-6b41323a3929 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.589317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05cf2-bd75-4013-899b-6b41323a3929 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.589576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05cf2-bd75-4013-899b-6b41323a3929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.597108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d05cf2-bd75-4013-899b-6b41323a3929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:16.598576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d05cf2-bd75-4013-899b-6b41323a3929 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:16.607345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1246/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:16.699226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e28f76-c1b5-4975-8767-6ef32d92a47c None None] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.699546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e28f76-c1b5-4975-8767-6ef32d92a47c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.700158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e28f76-c1b5-4975-8767-6ef32d92a47c None None] PATH_INFO: `/` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.702081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1254/2500] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 6 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:56:16.708924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac807-0024-40f9-a8ff-00b6e5dc3b66 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.709251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac807-0024-40f9-a8ff-00b6e5dc3b66 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.709586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac807-0024-40f9-a8ff-00b6e5dc3b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.735549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-acfac807-0024-40f9-a8ff-00b6e5dc3b66 None None] MFA Rules not processed for user `a782787a64c94d0f8a43f7f8deeb120b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:16.736769 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-acfac807-0024-40f9-a8ff-00b6e5dc3b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:16.747084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1247/2501] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 6 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:16.757875 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e28f76-c1b5-4975-8767-6ef32d92a47c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:16.769121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e28f76-c1b5-4975-8767-6ef32d92a47c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:16.772754 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:16.773390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:16.773609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:16.773878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:16.785467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:16.787038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:16.798527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1255/2502] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:19.699818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:19.700374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:19.700374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:19.724186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:19.725393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:19.733859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1248/2503] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:56:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:19.750471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:19.761789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c86d-56da-46c9-ab27-785eaee0f652 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:19.766679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e061b-0c63-4c96-bca3-ed81a8ef62c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:19.767308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e061b-0c63-4c96-bca3-ed81a8ef62c2 service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:19.767580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e061b-0c63-4c96-bca3-ed81a8ef62c2 service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:19.767841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e061b-0c63-4c96-bca3-ed81a8ef62c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:19.776208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e061b-0c63-4c96-bca3-ed81a8ef62c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:19.777773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e061b-0c63-4c96-bca3-ed81a8ef62c2 service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:19.785832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1256/2504] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:56:29.718143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=57 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:29.782577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=41 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:38.502703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:38.526416 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378494-41e5-4ec3-bda4-f57a8e2a74b4 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:38.531866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:38.532492 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:38.532753 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:38.533043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:38.534880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:38.561665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:38.563298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:38.573619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1249/2505] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:39.329498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:39.330022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:39.330022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:39.349731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:39.350970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:39.358159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1257/2506] 10.222.0.49 () {58 vars in 967 bytes} [Tue Sep 6 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:39.370256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:39.381582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25f2a5-3b5c-4297-9ae4-dfa8a5940c1c service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:39.387185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:39.387777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:39.388050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:39.388301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:39.396295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:39.397883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:39.405748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1250/2507] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:56:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:56:44.759799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:44.779520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed635-3ba8-4e16-a0fe-2b1c192a7f7b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:44.783424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:44.784030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:44.784310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:44.784620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:44.786659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:44.832191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:44.833621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:44.853568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1258/2508] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:48.084484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:48.086661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:48.102413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a2399-6861-4f47-b4f7-602369aade17 service swift] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:48.108352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:48.109213 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.109552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.109835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.111774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:48.128240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:48.130062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:48.143794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1251/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:48.144884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:48.147226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:48.166147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0883-bab8-437a-86d1-c441cd07bddf service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:48.171469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:48.172129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.172413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.172686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] PATH_INFO: `/v3/users/2c55486a82b54091ad04eaa32fdd3a36` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.173922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c55486a82b54091ad04eaa32fdd3a36)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:48.176617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:48.235308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c55486a82b54091ad04eaa32fdd3a36'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.235975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c55486a82b54091ad04eaa32fdd3a36'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.242765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c55486a82b54091ad04eaa32fdd3a36'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.254391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c55486a82b54091ad04eaa32fdd3a36'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.255032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-dc84b2d6-1b4c-4eae-9232-d806e5d8fb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c55486a82b54091ad04eaa32fdd3a36'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.276221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1259/2510] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:56:48 2022] DELETE /identity/v3/users/2c55486a82b54091ad04eaa32fdd3a36 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:48.462447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:48.473826 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77539eca-00ba-4833-bc10-67b255325dde service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:48.533988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:48.534658 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.534969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.535237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] PATH_INFO: `/v3/projects/b307832b1fb848feabec61709402ecad` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.536483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b307832b1fb848feabec61709402ecad)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:48.538422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:48.590886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b307832b1fb848feabec61709402ecad', 'request_id': 'req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.596454 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b307832b1fb848feabec61709402ecad', 'request_id': 'req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.603067 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b307832b1fb848feabec61709402ecad', 'request_id': 'req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.617392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] The token cache is being invalidate because project b307832b1fb848feabec61709402ecad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:56:48.617706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.618317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f8f3af5-ac3f-47d7-be6c-ac24e8387b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:48.619831 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1252/2511] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:56:48 2022] DELETE /identity/v3/projects/b307832b1fb848feabec61709402ecad => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:48.624922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.625210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.625485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.676218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:48.677376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:48.728119 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:48.748045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1260/2512] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:48.756183 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.756469 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.756757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.777713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:48.779013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:48.788457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1253/2513] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:48.792713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:48.811334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a57ca-cd9a-4573-9bfc-f6833729d43c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:48.817469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:48.818093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.818364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.818627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.819356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:56:48.819654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:48.821277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:48.833892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1261/2514] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:56:48.838948 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:48.848460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a5f85-db66-4017-bd90-c57b924d5e5c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:48.853969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:48.854570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.854878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.855149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.855784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:48.857675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:48.887283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1254/2515] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:56:48 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:56:48.892852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:48.905294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d6549-f918-4766-8a01-e62a951572e6 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:48.964178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:48.964694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:48.964970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:48.965241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:48.965936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:48.967938 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:48.992339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1262/2516] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:56:48 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:56:48.996881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.002588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:49.010225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429881b-0957-4143-b980-f5ed7940a7ef admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.016913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.017523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.017801 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.018068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.018797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.020401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.031706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1255/2517] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:56:49.036005 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.046825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab337-213a-45ac-9d5d-6f3b4520eed8 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.052683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8848d5-e8c2-4631-afe5-b06fc7a4990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.053299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8848d5-e8c2-4631-afe5-b06fc7a4990c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.053569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8848d5-e8c2-4631-afe5-b06fc7a4990c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.053837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8848d5-e8c2-4631-afe5-b06fc7a4990c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.054547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8848d5-e8c2-4631-afe5-b06fc7a4990c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.056253 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8848d5-e8c2-4631-afe5-b06fc7a4990c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.067778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1263/2518] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:56:49.072321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.082698 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63fc4-a07c-4bc1-b1e2-ddc19339888b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.087835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.088486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.088759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.089030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] PATH_INFO: `/v3/projects/b7d0198ffe954001adb29efbfb1b03c8/users/65554acb86f04723b235fe2458a8e3e6/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.104137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d0198ffe954001adb29efbfb1b03c8, user_id=65554acb86f04723b235fe2458a8e3e6, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.106817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.122688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1256/2519] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:56:49 2022] PUT /identity/v3/projects/b7d0198ffe954001adb29efbfb1b03c8/users/65554acb86f04723b235fe2458a8e3e6/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:49.133115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.133418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.133709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.163053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] MFA Rules not processed for user `65554acb86f04723b235fe2458a8e3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:49.164288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:49.234463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1264/2520] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:49.239196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.303391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4bc0d-4d93-4ae8-af52-e5f998e8cd6e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.308098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.308706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.308993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.309289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.309926 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.311918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.342721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1257/2521] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:56:49 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:56:49.346987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.359223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ebfe8-ed25-4d25-804f-f03fec94ac27 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.406243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:49.419239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.419847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.420123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.420391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.421011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.422955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.446062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1265/2522] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:56:49 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:56:49.450181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.460527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8baa1-bb0e-4624-95a7-55798a284e07 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.465742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.466344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.466621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.466922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.467565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.469181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.480566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1258/2523] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:56:49.484920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.494888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2c56d-a952-4d5f-b69e-c16c8d9d9e83 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.499802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.500454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.500726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.500988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] PATH_INFO: `/v3/projects/69b42e5b846f4511af8adb4b05ad4778/users/0550ec8e28154e82ade95997a327680b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.515466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b42e5b846f4511af8adb4b05ad4778, user_id=0550ec8e28154e82ade95997a327680b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.518105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.532936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1266/2524] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:56:49 2022] PUT /identity/v3/projects/69b42e5b846f4511af8adb4b05ad4778/users/0550ec8e28154e82ade95997a327680b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:49.536931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.546925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ee40b-a4db-44c6-8f05-e35fa5eef594 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.606898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb5ca-2294-489c-ba45-723c339d2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.607495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5ca-2294-489c-ba45-723c339d2343 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.607770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5ca-2294-489c-ba45-723c339d2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.608033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5ca-2294-489c-ba45-723c339d2343 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.608665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcb5ca-2294-489c-ba45-723c339d2343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.610249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcb5ca-2294-489c-ba45-723c339d2343 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.619817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1259/2525] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:56:49.624318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.635281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22319ee-1061-4c33-b475-4e264cc692e1 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.640646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.641335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.641611 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.641879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] PATH_INFO: `/v3/projects/69b42e5b846f4511af8adb4b05ad4778/users/0550ec8e28154e82ade95997a327680b/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.644097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b42e5b846f4511af8adb4b05ad4778, user_id=0550ec8e28154e82ade95997a327680b, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.646793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.657944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1267/2526] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:56:49 2022] PUT /identity/v3/projects/69b42e5b846f4511af8adb4b05ad4778/users/0550ec8e28154e82ade95997a327680b/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:49.669582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.669862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.670128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.697669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] MFA Rules not processed for user `0550ec8e28154e82ade95997a327680b`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:49.698903 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:49.726627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:49.772262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1260/2527] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:49.785480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:49.787624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:49.881975 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bc77a-6936-4c6d-be81-d857b778c124 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:49.886041 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24576217-94ef-448a-82f6-5c7448caaa7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:49.886629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24576217-94ef-448a-82f6-5c7448caaa7f service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:49.886942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24576217-94ef-448a-82f6-5c7448caaa7f service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:49.887215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24576217-94ef-448a-82f6-5c7448caaa7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:49.896357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24576217-94ef-448a-82f6-5c7448caaa7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:49.897814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24576217-94ef-448a-82f6-5c7448caaa7f service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:49.910295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1268/2528] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:50.063305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:50.128577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d2f3-6b6c-4d5c-9f62-c6e5cd151cc9 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:50.135890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:50.136787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:50.137112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:50.137498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] PATH_INFO: `/v3/users/65554acb86f04723b235fe2458a8e3e6` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:50.138778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65554acb86f04723b235fe2458a8e3e6)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:50.140790 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:50.190419 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65554acb86f04723b235fe2458a8e3e6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.191083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65554acb86f04723b235fe2458a8e3e6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.198217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65554acb86f04723b235fe2458a8e3e6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.212485 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65554acb86f04723b235fe2458a8e3e6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.213109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65554acb86f04723b235fe2458a8e3e6'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.228266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1261/2529] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:56:50 2022] DELETE /identity/v3/users/65554acb86f04723b235fe2458a8e3e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:50.232926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:50.233413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:50.233542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:50.252483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:50.253686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:50.312963 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1269/2530] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:50.323407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:50.325692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:50.380399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:50.408125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2f4b-22ec-41c4-b609-595fb1db5244 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:50.412123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:50.412745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:50.413026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:50.413299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:50.423000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:50.424448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:50.434006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1262/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:50.708766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:50.710252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:50.723091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4d990-5039-4a56-898c-8c5ef75bc5c8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:50.728770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:50.729491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:50.729850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:50.730180 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] PATH_INFO: `/v3/projects/b7d0198ffe954001adb29efbfb1b03c8` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:50.731520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d0198ffe954001adb29efbfb1b03c8)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:50.733813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:50.756969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:50.783776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d0198ffe954001adb29efbfb1b03c8', 'request_id': 'req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.789350 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d0198ffe954001adb29efbfb1b03c8', 'request_id': 'req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.797689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d0198ffe954001adb29efbfb1b03c8', 'request_id': 'req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.808748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] The token cache is being invalidate because project b7d0198ffe954001adb29efbfb1b03c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:56:50.809028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.809714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.811266 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1270/2532] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:56:50 2022] DELETE /identity/v3/projects/b7d0198ffe954001adb29efbfb1b03c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:50.815511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:50.825261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3f456-0dde-411e-b22f-d056d26ff986 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:50.881228 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:50.881849 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:50.882124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:50.882389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] PATH_INFO: `/v3/users/0550ec8e28154e82ade95997a327680b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:50.883539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0550ec8e28154e82ade95997a327680b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:50.885456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:50.932685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0550ec8e28154e82ade95997a327680b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.933337 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0550ec8e28154e82ade95997a327680b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.940341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0550ec8e28154e82ade95997a327680b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.952470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0550ec8e28154e82ade95997a327680b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.953124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-4194c5d8-b25c-4bf5-b2d2-689f7779200f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0550ec8e28154e82ade95997a327680b'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:50.967940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1263/2533] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:56:50 2022] DELETE /identity/v3/users/0550ec8e28154e82ade95997a327680b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:56:51.252924 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.254467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:51.269721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fb50d-da19-4f09-a6e0-f8fb04d65926 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.331786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.332334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.332609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.332879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] PATH_INFO: `/v3/projects/69b42e5b846f4511af8adb4b05ad4778` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.334036 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b42e5b846f4511af8adb4b05ad4778)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.336007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.387243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b42e5b846f4511af8adb4b05ad4778', 'request_id': 'req-84d4985e-ce7c-42c6-b559-a24b20761a5c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:51.392968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b42e5b846f4511af8adb4b05ad4778', 'request_id': 'req-84d4985e-ce7c-42c6-b559-a24b20761a5c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:51.400677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b42e5b846f4511af8adb4b05ad4778', 'request_id': 'req-84d4985e-ce7c-42c6-b559-a24b20761a5c'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:51.412018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] The token cache is being invalidate because project 69b42e5b846f4511af8adb4b05ad4778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:56:51.412311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:51.413021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-84d4985e-ce7c-42c6-b559-a24b20761a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:56:51.414653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1271/2534] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:56:51 2022] DELETE /identity/v3/projects/69b42e5b846f4511af8adb4b05ad4778 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:51.419938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.420470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.420470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.441025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:51.442231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:51.491933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:51.506665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1264/2535] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:51.514623 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.514954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.515255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.536386 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:51.537581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:51.546048 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1272/2536] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:51.550493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.560639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec5fe8-c518-4451-ae0f-e3f6ed777ea5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.565802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.566424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.566741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.567045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.567699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:56:51.568006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.569630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.581677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1265/2537] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:56:51.586030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.595876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a79c-45a1-4869-87a3-69e73807f2b3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.601508 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.602111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.602380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.602642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.603306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.605214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.634526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1273/2538] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:56:51 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:56:51.639015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.649678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9788b94-6a6e-457e-b05c-c2aaecc6329c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.707734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.708341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.708622 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.708880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.709540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.711852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.736405 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1266/2539] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:56:51 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:56:51.740583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.751438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe9d5-5db0-400c-be5e-3442e9ca2e57 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.756412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.757001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.757278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.757538 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.758203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.759824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.761891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:51.770764 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1274/2540] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:56:51.774988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.785008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869673c-775d-43c3-98d7-5ee3b3a7ccf3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.789817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9b5ff-9acb-47b9-b09a-e350913a4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.790445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9b5ff-9acb-47b9-b09a-e350913a4633 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.790724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9b5ff-9acb-47b9-b09a-e350913a4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.790970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9b5ff-9acb-47b9-b09a-e350913a4633 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.791603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9b5ff-9acb-47b9-b09a-e350913a4633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.793226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9b5ff-9acb-47b9-b09a-e350913a4633 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.804060 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1267/2541] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:56:51.808307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:51.818789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f166fa-3bcb-46a8-8546-1494a94a667c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:51.824522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:51.825174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.825455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.825735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] PATH_INFO: `/v3/projects/35d4cc42c51e4522a5f603b6e8d9d1eb/users/e190d1a1509b45119520a7aad958fd3d/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.842562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d4cc42c51e4522a5f603b6e8d9d1eb, user_id=e190d1a1509b45119520a7aad958fd3d, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:51.845197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:51.860422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1275/2542] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:56:51 2022] PUT /identity/v3/projects/35d4cc42c51e4522a5f603b6e8d9d1eb/users/e190d1a1509b45119520a7aad958fd3d/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:51.871986 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:51.872248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:51.872544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:51.900206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] MFA Rules not processed for user `e190d1a1509b45119520a7aad958fd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:51.901428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:51.973143 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1268/2543] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:51.977899 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.042394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afcd78-efee-4c5a-8e92-6e146cdcd744 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.047550 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.048155 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.048418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.048690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.049331 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.051244 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.080468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1276/2544] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:56:51 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:56:52.084775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.096646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8f21c-c74a-4d36-9524-8f3ee3d1e3ca None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.142616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:52.156249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.156870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.157151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.157428 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.158073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.160035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.182980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1269/2545] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:56:52 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:56:52.187339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.200523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f7be-d6cd-492d-8f4e-22b120160404 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.205945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.206552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.206862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.207132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.207776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.209421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.221281 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1277/2546] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:56:52.225634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.236327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a2528-a7b4-4c03-b7ef-eb694f2d3828 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.241882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.242552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.242916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.243191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] PATH_INFO: `/v3/projects/0b22cc86dba845bbb432ce5b2ffe37d5/users/f76e5af3006a4394976982f528368c76/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.259293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b22cc86dba845bbb432ce5b2ffe37d5, user_id=f76e5af3006a4394976982f528368c76, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.262026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.279317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1270/2547] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:56:52 2022] PUT /identity/v3/projects/0b22cc86dba845bbb432ce5b2ffe37d5/users/f76e5af3006a4394976982f528368c76/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:52.283501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.294195 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e7cc1-aba2-4c3a-b4ea-342997f384bb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.352411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae955df0-8ae1-47af-9a24-ce6463660eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.352939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955df0-8ae1-47af-9a24-ce6463660eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.353209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955df0-8ae1-47af-9a24-ce6463660eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.353475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955df0-8ae1-47af-9a24-ce6463660eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.354106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae955df0-8ae1-47af-9a24-ce6463660eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.355725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae955df0-8ae1-47af-9a24-ce6463660eb2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.365819 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1278/2548] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:56:52.370458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.381696 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad0be7-8607-42b2-a4d5-19c32eb038ad admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.387311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.388026 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.388310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.388586 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] PATH_INFO: `/v3/projects/0b22cc86dba845bbb432ce5b2ffe37d5/users/f76e5af3006a4394976982f528368c76/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.390516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b22cc86dba845bbb432ce5b2ffe37d5, user_id=f76e5af3006a4394976982f528368c76, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.393180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.404719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1271/2549] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:56:52 2022] PUT /identity/v3/projects/0b22cc86dba845bbb432ce5b2ffe37d5/users/f76e5af3006a4394976982f528368c76/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:56:52.416265 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.416566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.416833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.446159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] MFA Rules not processed for user `f76e5af3006a4394976982f528368c76`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:52.447405 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:52.481627 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:52.522491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1279/2550] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:52.534020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.535995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:52.597344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2439e3-07cf-4b23-b32d-40b8dccbfd92 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.601413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.602012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.602288 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.602634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.612000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.613441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.623080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1272/2551] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:52.706349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:52.717248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38052e36-7cb1-4bdd-93dd-1ac79024268b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:52.721520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c67466-10f8-4657-bae8-c5950ea27c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:52.722135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67466-10f8-4657-bae8-c5950ea27c57 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:52.722412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67466-10f8-4657-bae8-c5950ea27c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:52.722702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67466-10f8-4657-bae8-c5950ea27c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:52.783385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67466-10f8-4657-bae8-c5950ea27c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:52.784832 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67466-10f8-4657-bae8-c5950ea27c57 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:52.794519 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1280/2552] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:02.618819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:02.789918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=42 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:07.900327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:07.964385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404abbd2-b04f-4c31-978e-800daf68c354 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:07.969837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:07.970465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:07.970774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:07.971042 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] PATH_INFO: `/v3/users/e190d1a1509b45119520a7aad958fd3d` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:07.972296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e190d1a1509b45119520a7aad958fd3d)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:07.974226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:08.029266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e190d1a1509b45119520a7aad958fd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.029955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e190d1a1509b45119520a7aad958fd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.036730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e190d1a1509b45119520a7aad958fd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.048378 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e190d1a1509b45119520a7aad958fd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.049047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e190d1a1509b45119520a7aad958fd3d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.063252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1273/2553] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:07 2022] DELETE /identity/v3/users/e190d1a1509b45119520a7aad958fd3d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:08.067942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:08.068442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:08.068542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:08.088932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:08.090148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:08.153308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1281/2554] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:08.163377 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:08.164934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:08.225157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b55a-16a7-496f-8360-7d0986367912 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:08.228997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:08.229613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:08.229909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:08.230184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:08.239289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:08.240728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:08.250184 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1274/2555] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:08.526837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:08.528363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:08.541319 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5bfb-cad2-44de-9907-199d3faa84f5 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:08.546909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:08.547563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:08.547840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:08.548108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] PATH_INFO: `/v3/projects/35d4cc42c51e4522a5f603b6e8d9d1eb` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:08.549389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d4cc42c51e4522a5f603b6e8d9d1eb)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:08.551497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:08.605170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d4cc42c51e4522a5f603b6e8d9d1eb', 'request_id': 'req-875975fa-ca9a-4ae3-87a1-38ce1b996b05'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.611540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d4cc42c51e4522a5f603b6e8d9d1eb', 'request_id': 'req-875975fa-ca9a-4ae3-87a1-38ce1b996b05'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.619822 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d4cc42c51e4522a5f603b6e8d9d1eb', 'request_id': 'req-875975fa-ca9a-4ae3-87a1-38ce1b996b05'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.631302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] The token cache is being invalidate because project 35d4cc42c51e4522a5f603b6e8d9d1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:08.631587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.632226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.633743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1282/2556] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:08 2022] DELETE /identity/v3/projects/35d4cc42c51e4522a5f603b6e8d9d1eb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:08.638001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:08.648224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad5b27-cef8-479d-8fde-928322bd9e2a service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:08.667528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:08.711107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:08.712103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:08.712349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:08.712612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] PATH_INFO: `/v3/users/f76e5af3006a4394976982f528368c76` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:08.713878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76e5af3006a4394976982f528368c76)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:08.716038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:08.768995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76e5af3006a4394976982f528368c76'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.769632 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76e5af3006a4394976982f528368c76'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.776349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76e5af3006a4394976982f528368c76'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.787785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76e5af3006a4394976982f528368c76'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.788472 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-389c5164-4afe-4305-aff3-2894d86b782a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76e5af3006a4394976982f528368c76'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:08.802286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1275/2557] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:08 2022] DELETE /identity/v3/users/f76e5af3006a4394976982f528368c76 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:09.192696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.194145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:09.208256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875975fa-ca9a-4ae3-87a1-38ce1b996b05 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.269624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.270284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.270541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.270846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] PATH_INFO: `/v3/projects/0b22cc86dba845bbb432ce5b2ffe37d5` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.272015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b22cc86dba845bbb432ce5b2ffe37d5)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.273941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.308330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:09.326527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b22cc86dba845bbb432ce5b2ffe37d5', 'request_id': 'req-2e2d1182-a9d2-4398-8a45-6832b18d0f94'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:09.332297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b22cc86dba845bbb432ce5b2ffe37d5', 'request_id': 'req-2e2d1182-a9d2-4398-8a45-6832b18d0f94'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:09.343134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b22cc86dba845bbb432ce5b2ffe37d5', 'request_id': 'req-2e2d1182-a9d2-4398-8a45-6832b18d0f94'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:09.356221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] The token cache is being invalidate because project 0b22cc86dba845bbb432ce5b2ffe37d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:09.356502 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:09.357182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2e2d1182-a9d2-4398-8a45-6832b18d0f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:09.358849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1283/2558] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:09 2022] DELETE /identity/v3/projects/0b22cc86dba845bbb432ce5b2ffe37d5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:09.364090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.364636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.364636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.386600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:09.387857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:09.448392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1276/2559] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:09.457280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.457644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.458017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.488945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:09.490176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:09.499797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1284/2560] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:09.504280 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.514655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5ad48-72ab-4e68-8200-bbe7c02282d7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.520554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.521160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.521431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.521693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.522335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:09.522633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.524258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.536061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1277/2561] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:09.540203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.549722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7a89-5936-4bcf-921b-759110dcae51 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.555028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.555628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.555906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.556174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.556810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.558715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.589993 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1285/2562] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:09 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:09.596507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.611522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f812fae-eeaf-4b1f-bf8c-c7bb2cecae0b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.639355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:09.673049 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.673662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.673934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.674200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.674868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.676803 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.699846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1278/2563] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:09 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:09.704184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.715900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a3c60-7bc9-46ac-adf7-321b634eeeea admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.721486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.722084 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.722354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.722653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.723336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.724936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.735530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1286/2564] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:09.739755 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.750945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec34d04-6788-4d23-a8e3-de39a0fe7db6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.756397 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66435d32-f856-4f4a-82c8-15b1bd7f5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.757011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66435d32-f856-4f4a-82c8-15b1bd7f5134 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.757284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66435d32-f856-4f4a-82c8-15b1bd7f5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.757558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66435d32-f856-4f4a-82c8-15b1bd7f5134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.758218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66435d32-f856-4f4a-82c8-15b1bd7f5134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.759880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66435d32-f856-4f4a-82c8-15b1bd7f5134 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.770788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1279/2565] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:09.775109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.785192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7b9d-e063-4c06-9304-104fe99811ff admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.789930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.790564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.790874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.791142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] PATH_INFO: `/v3/projects/0f94baeaacb74a5e9160d9175fd91ec0/users/45f6d59470ad4cfab9fcf86e48429072/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.805649 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f94baeaacb74a5e9160d9175fd91ec0, user_id=45f6d59470ad4cfab9fcf86e48429072, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.808308 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.823323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1287/2566] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:09 2022] PUT /identity/v3/projects/0f94baeaacb74a5e9160d9175fd91ec0/users/45f6d59470ad4cfab9fcf86e48429072/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:09.835457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.835879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.836286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.865484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] MFA Rules not processed for user `45f6d59470ad4cfab9fcf86e48429072`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:09.866675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:09.932495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1280/2567] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:09.938738 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.002736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537675-6f83-43be-a7fb-d0808955ea2e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.007897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.008496 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.008769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.009039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.009677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.011630 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.040411 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1288/2568] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:09 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:57:10.046001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.057308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8b28-e69a-4653-a67c-a594a7c5417e None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.121384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.122016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.122297 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.122568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.123256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.125185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.149663 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1281/2569] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:10 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:10.153771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.164412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a8db6-8471-4fdc-a629-46efcbe1ca88 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.169143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.169742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.170018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.170289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.171042 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.172657 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.183314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1289/2570] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:10.187707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.198424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb62d-b423-4111-b06e-3e9e99e4c26c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.204055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.204715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.205115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.205235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] PATH_INFO: `/v3/projects/a7f12756feee4612bca4045be37137d3/users/764a876ab82241718c7ba118f140b919/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.222207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f12756feee4612bca4045be37137d3, user_id=764a876ab82241718c7ba118f140b919, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.225265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.239481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1282/2571] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:10 2022] PUT /identity/v3/projects/a7f12756feee4612bca4045be37137d3/users/764a876ab82241718c7ba118f140b919/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:10.243540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.253968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bd9f7-15b7-41da-90f4-4550caa244ea admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.273919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:10.309774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebab91e-32cc-4e01-9423-9a95e96ce290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.310375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab91e-32cc-4e01-9423-9a95e96ce290 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.310646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab91e-32cc-4e01-9423-9a95e96ce290 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.310930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebab91e-32cc-4e01-9423-9a95e96ce290 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.311576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebab91e-32cc-4e01-9423-9a95e96ce290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.313165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebab91e-32cc-4e01-9423-9a95e96ce290 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.325383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1290/2572] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:10.330105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.336027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:10.343689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ea337-7e34-42e8-81c6-49805d733305 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.349272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.349924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.350197 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.350462 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] PATH_INFO: `/v3/projects/a7f12756feee4612bca4045be37137d3/users/764a876ab82241718c7ba118f140b919/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.352550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f12756feee4612bca4045be37137d3, user_id=764a876ab82241718c7ba118f140b919, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.355246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.365969 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1283/2573] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:10 2022] PUT /identity/v3/projects/a7f12756feee4612bca4045be37137d3/users/764a876ab82241718c7ba118f140b919/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:10.376339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.376622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.376892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.406570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] MFA Rules not processed for user `764a876ab82241718c7ba118f140b919`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:10.407799 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:10.486840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1291/2574] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:10.500670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:10.502818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:10.567324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c01fd-3927-445a-8726-3c4edef80610 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:10.573334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652514-04a6-41b5-9c2a-f338cbf0640f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:10.574206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652514-04a6-41b5-9c2a-f338cbf0640f service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:10.574529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652514-04a6-41b5-9c2a-f338cbf0640f service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:10.574907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652514-04a6-41b5-9c2a-f338cbf0640f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:10.590647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0652514-04a6-41b5-9c2a-f338cbf0640f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:10.592852 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0652514-04a6-41b5-9c2a-f338cbf0640f service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:10.602785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1284/2575] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:12.006112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:12.074486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c85f-9ebd-46f8-a6ab-6349320b7c3d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:12.079269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:12.079896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:12.080171 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:12.080442 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] PATH_INFO: `/v3/users/45f6d59470ad4cfab9fcf86e48429072` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:12.081574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f6d59470ad4cfab9fcf86e48429072)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:12.083530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:12.137695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f6d59470ad4cfab9fcf86e48429072'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.138291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f6d59470ad4cfab9fcf86e48429072'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.139549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:12.147292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f6d59470ad4cfab9fcf86e48429072'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.159301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f6d59470ad4cfab9fcf86e48429072'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.160049 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f6d59470ad4cfab9fcf86e48429072'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.175003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1292/2576] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:12 2022] DELETE /identity/v3/users/45f6d59470ad4cfab9fcf86e48429072 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:12.179835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:12.180343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:12.180440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:12.200388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:12.201856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:12.266149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1285/2577] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:12.276239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:12.278065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:12.337976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017024-fb60-4bf2-83b5-2b6a9abda9eb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:12.342373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:12.343007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:12.343288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:12.343554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:12.353050 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:12.354491 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:12.364513 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1293/2578] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:12.640518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:12.642955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:12.660380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573392a-a5dd-4e7b-9abc-7c927c1df3d5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:12.672380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:12.673056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:12.673334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:12.673605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] PATH_INFO: `/v3/projects/0f94baeaacb74a5e9160d9175fd91ec0` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:12.674787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f94baeaacb74a5e9160d9175fd91ec0)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:12.676731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:12.729242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f94baeaacb74a5e9160d9175fd91ec0', 'request_id': 'req-8f2167fa-d636-4b7f-b82e-4610a65b770d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.735341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f94baeaacb74a5e9160d9175fd91ec0', 'request_id': 'req-8f2167fa-d636-4b7f-b82e-4610a65b770d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.741745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f94baeaacb74a5e9160d9175fd91ec0', 'request_id': 'req-8f2167fa-d636-4b7f-b82e-4610a65b770d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.756997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] The token cache is being invalidate because project 0f94baeaacb74a5e9160d9175fd91ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:12.757282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.757956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.759554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1286/2579] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:12 2022] DELETE /identity/v3/projects/0f94baeaacb74a5e9160d9175fd91ec0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:12.763638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:12.773548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaadb2c-e048-4b7b-93e6-5d60b5c23595 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:12.831053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:12.831670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:12.831945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:12.832212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] PATH_INFO: `/v3/users/764a876ab82241718c7ba118f140b919` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:12.833342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764a876ab82241718c7ba118f140b919)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:12.835300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:12.883682 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764a876ab82241718c7ba118f140b919'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.884321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764a876ab82241718c7ba118f140b919'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.891356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764a876ab82241718c7ba118f140b919'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.902598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:12.905191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764a876ab82241718c7ba118f140b919'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.906074 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-f8858e6a-75bc-4204-8eb6-badd608a1770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764a876ab82241718c7ba118f140b919'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:12.921259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1294/2580] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:12 2022] DELETE /identity/v3/users/764a876ab82241718c7ba118f140b919 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:13.205574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.207144 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:13.225131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2167fa-d636-4b7f-b82e-4610a65b770d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.239863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:13.286943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.287510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.287786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.288055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] PATH_INFO: `/v3/projects/a7f12756feee4612bca4045be37137d3` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.289194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f12756feee4612bca4045be37137d3)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.291162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.339516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f12756feee4612bca4045be37137d3', 'request_id': 'req-876f6887-0027-49f0-97be-a335b3787099'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:13.345137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f12756feee4612bca4045be37137d3', 'request_id': 'req-876f6887-0027-49f0-97be-a335b3787099'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:13.351369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f12756feee4612bca4045be37137d3', 'request_id': 'req-876f6887-0027-49f0-97be-a335b3787099'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:13.364973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] The token cache is being invalidate because project a7f12756feee4612bca4045be37137d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:13.365255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:13.365862 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-876f6887-0027-49f0-97be-a335b3787099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:13.367353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1287/2581] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:13 2022] DELETE /identity/v3/projects/a7f12756feee4612bca4045be37137d3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:13.372366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.372955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.372955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.392742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:13.393929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:13.453784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1295/2582] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:13.463367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.463646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.463915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.484923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:13.486150 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:13.495236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1288/2583] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:13.499610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.510407 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe9e70-9254-4bc0-910d-095b9ca5794a None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.516225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.516818 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.517087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.517347 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.517991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:13.518284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.519919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.532908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1296/2584] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:13.537495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.546950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e953187-7f8a-459b-98db-bd87fa777048 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.552234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.552828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.553100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.553367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.553993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.555919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.583857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1289/2585] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:13 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:13.588476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.599181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357564b4-6f68-4549-a3ad-963e1af6fd37 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.658850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.659495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.659814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.660097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.660731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.662732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.688729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1297/2586] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:13 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:57:13.689861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.700621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a59e9f-20d3-402d-95fd-52afa496fce6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.706851 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.707463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.707748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.707988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.708641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.710273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.722023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1290/2587] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:13.726838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.737282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606bac-7776-45ad-9739-5daa5e276c65 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.747686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dda19-d2bf-4643-9e50-69ca311efb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.748316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dda19-d2bf-4643-9e50-69ca311efb51 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.748641 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dda19-d2bf-4643-9e50-69ca311efb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.748917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dda19-d2bf-4643-9e50-69ca311efb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.749569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1dda19-d2bf-4643-9e50-69ca311efb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.751375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1dda19-d2bf-4643-9e50-69ca311efb51 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.776033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1298/2588] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:13.780470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.791859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedc0c8-ce73-4458-9fa1-511ab9fe7b49 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:13.796613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:13.797278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.797571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.797830 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] PATH_INFO: `/v3/projects/3b656b4800a146d98177e2e052bf47d8/users/892d5ca45beb478d8984b20c650b596f/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.812817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b656b4800a146d98177e2e052bf47d8, user_id=892d5ca45beb478d8984b20c650b596f, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:13.815569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:13.830616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1291/2589] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:13 2022] PUT /identity/v3/projects/3b656b4800a146d98177e2e052bf47d8/users/892d5ca45beb478d8984b20c650b596f/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:13.841152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:13.841434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:13.841724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:13.870880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] MFA Rules not processed for user `892d5ca45beb478d8984b20c650b596f`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:13.872091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:13.913883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:13.937546 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1299/2590] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:13.942125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:13.988325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:14.007365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0a80-79cc-4c06-ba18-e3106fe2ca7e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.012569 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.013178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.013456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.013728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.014353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.016351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.045597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1292/2591] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:13 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:14.049816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.060881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ad0de-d83d-4f36-af29-29b09943348c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.122047 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.122668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.122988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.123286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.123931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.125900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.150933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1300/2592] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:14 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:14.156415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.167352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8ddb-cb59-4ef3-b9c6-ad8c612854ad admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.173503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.174171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.174446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.174731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.175376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.176988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.191153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1293/2593] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:14.195372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.206208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e1c3-d099-4ea9-9982-fc78250e2658 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.212448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.213093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.213365 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.213622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] PATH_INFO: `/v3/projects/b472bb5795f54ebca5ff3398d33b54dc/users/b6245a7049e64b3086c9af311b035591/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.229583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b472bb5795f54ebca5ff3398d33b54dc, user_id=b6245a7049e64b3086c9af311b035591, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.232289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.245687 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1301/2594] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:14 2022] PUT /identity/v3/projects/b472bb5795f54ebca5ff3398d33b54dc/users/b6245a7049e64b3086c9af311b035591/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:14.249775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.260648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed01c9-e146-4629-b445-058e1f67301f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.320528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703196b-b5ef-41e2-a398-777a2df50681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.321054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703196b-b5ef-41e2-a398-777a2df50681 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.321329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703196b-b5ef-41e2-a398-777a2df50681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.321595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703196b-b5ef-41e2-a398-777a2df50681 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.322224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703196b-b5ef-41e2-a398-777a2df50681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.323905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703196b-b5ef-41e2-a398-777a2df50681 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.333955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1294/2595] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:14.339644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.350360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f192-8386-46f5-8102-29e70a1b8f9b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.355390 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.356028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.356299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.356568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] PATH_INFO: `/v3/projects/b472bb5795f54ebca5ff3398d33b54dc/users/b6245a7049e64b3086c9af311b035591/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.358514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b472bb5795f54ebca5ff3398d33b54dc, user_id=b6245a7049e64b3086c9af311b035591, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.361203 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.371329 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1302/2596] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:14 2022] PUT /identity/v3/projects/b472bb5795f54ebca5ff3398d33b54dc/users/b6245a7049e64b3086c9af311b035591/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:14.381529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.381823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.382095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.411250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] MFA Rules not processed for user `b6245a7049e64b3086c9af311b035591`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:14.412481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:14.482153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1295/2597] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:14.493995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.495950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:14.556740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa2e5d-8305-45cc-9525-d253cd965e55 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.561494 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.562223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.562568 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.562987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.574292 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.575686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.585949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1303/2598] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:14.636673 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:14.638355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:14.651576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e1ea6-183a-4bb3-a282-e3fabc9f8b35 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:14.655475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705611-f7b9-4758-b902-932d3c40101c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:14.656105 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705611-f7b9-4758-b902-932d3c40101c service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:14.656384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705611-f7b9-4758-b902-932d3c40101c service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:14.656655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705611-f7b9-4758-b902-932d3c40101c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:14.692639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:14.718267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705611-f7b9-4758-b902-932d3c40101c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:14.719763 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705611-f7b9-4758-b902-932d3c40101c service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:14.729286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1296/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:18.101690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:18.145269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:18.168847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2065-679e-4413-951f-4c81328981fd service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:18.174618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:18.175286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:18.175563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:18.175831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] PATH_INFO: `/v3/users/892d5ca45beb478d8984b20c650b596f` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:18.177414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892d5ca45beb478d8984b20c650b596f)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:18.179406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:18.233934 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892d5ca45beb478d8984b20c650b596f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.234703 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892d5ca45beb478d8984b20c650b596f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.242290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892d5ca45beb478d8984b20c650b596f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.255231 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892d5ca45beb478d8984b20c650b596f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.255918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892d5ca45beb478d8984b20c650b596f'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.269802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1304/2600] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:18 2022] DELETE /identity/v3/users/892d5ca45beb478d8984b20c650b596f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:18.274644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:18.275170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:18.275290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:18.294436 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:18.295621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:18.359833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1297/2601] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:18.370085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:18.371793 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:18.432873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cb119-cb01-496a-bb51-1e3120730fb1 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:18.436620 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:18.437245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:18.437520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:18.437787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:18.447115 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:18.448958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:18.458332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1305/2602] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:18.740515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:18.742009 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:18.754634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce88-5358-42de-81d0-52f12a00f061 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:18.759772 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:18.760440 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:18.760707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:18.760970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] PATH_INFO: `/v3/projects/3b656b4800a146d98177e2e052bf47d8` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:18.762072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b656b4800a146d98177e2e052bf47d8)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:18.763999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:18.810232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b656b4800a146d98177e2e052bf47d8', 'request_id': 'req-d403d448-5bec-4598-b633-2ef68e350f03'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.815806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b656b4800a146d98177e2e052bf47d8', 'request_id': 'req-d403d448-5bec-4598-b633-2ef68e350f03'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.822748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b656b4800a146d98177e2e052bf47d8', 'request_id': 'req-d403d448-5bec-4598-b633-2ef68e350f03'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.840252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] The token cache is being invalidate because project 3b656b4800a146d98177e2e052bf47d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:18.840623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.841692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.844151 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1298/2603] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:18 2022] DELETE /identity/v3/projects/3b656b4800a146d98177e2e052bf47d8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:18.848755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:18.859051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c532-7151-40f5-a4aa-ae7d94509067 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:18.918870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:18.919499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:18.919768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:18.920031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] PATH_INFO: `/v3/users/b6245a7049e64b3086c9af311b035591` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:18.921144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6245a7049e64b3086c9af311b035591)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:18.923159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:18.924596 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:18.976008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6245a7049e64b3086c9af311b035591'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.976671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6245a7049e64b3086c9af311b035591'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.983576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6245a7049e64b3086c9af311b035591'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.995921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6245a7049e64b3086c9af311b035591'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:18.996612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-7d8f4a9c-8097-48e0-bd43-b2e0c0b9a2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6245a7049e64b3086c9af311b035591'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:19.011212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1306/2604] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:18 2022] DELETE /identity/v3/users/b6245a7049e64b3086c9af311b035591 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:19.295261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.296805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:19.310721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403d448-5bec-4598-b633-2ef68e350f03 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.368483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.369048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.369322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.369593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] PATH_INFO: `/v3/projects/b472bb5795f54ebca5ff3398d33b54dc` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.370703 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b472bb5795f54ebca5ff3398d33b54dc)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.372648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.374030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:19.421682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b472bb5795f54ebca5ff3398d33b54dc', 'request_id': 'req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:19.427918 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b472bb5795f54ebca5ff3398d33b54dc', 'request_id': 'req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:19.434761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b472bb5795f54ebca5ff3398d33b54dc', 'request_id': 'req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:19.449072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] The token cache is being invalidate because project b472bb5795f54ebca5ff3398d33b54dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:19.449366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:19.449998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-83a58ae8-5fe6-4dd6-bc14-d63f85d1c493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:19.451542 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1299/2605] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:19 2022] DELETE /identity/v3/projects/b472bb5795f54ebca5ff3398d33b54dc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:19.456517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.457022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.457133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.477984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:19.479240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:19.546205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1307/2606] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:19.555163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.555446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.555719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.576201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:19.577407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:19.585765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1300/2607] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:19.590191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.600264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c16c6-6958-41ef-8a99-d6897676e79f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.605134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.605745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.606020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.606294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.606961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:19.607262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.608870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.620787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1308/2608] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:19.625071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.635363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8ac5-dd30-4f9c-a729-e3f5aac172c2 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.640293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.641002 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.641349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.641690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.642427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.644470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.684832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1301/2609] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:19 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:19.689070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.699230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d457f-0a81-4350-9119-3e490fa3fd8c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.759044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.759650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.759920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.760202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.760817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.762789 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.773706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:19.788003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1309/2610] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:19 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:19.792328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.802589 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eaea2-ea8d-43ae-97c9-b67e4f49951f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.807383 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.807978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.808252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.808526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.809153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.810756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.821141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1302/2611] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:19.825309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.835930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ad14b-4e4a-40fd-a8b0-c7d85108c513 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.841879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c40a7-a8a5-49ee-bd5a-ae502152f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.842478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c40a7-a8a5-49ee-bd5a-ae502152f189 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.842797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c40a7-a8a5-49ee-bd5a-ae502152f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.843070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c40a7-a8a5-49ee-bd5a-ae502152f189 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.843711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c40a7-a8a5-49ee-bd5a-ae502152f189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.845342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c40a7-a8a5-49ee-bd5a-ae502152f189 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.856018 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1310/2612] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:19.860252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:19.870992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4db49-f503-4105-b45c-e6db3d46c19f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:19.876347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:19.877021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.877301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.877572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] PATH_INFO: `/v3/projects/d9c4316949ac4ee5afcbf305c0b4ae86/users/e1d07f55556444299c731134c38989cf/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.892679 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c4316949ac4ee5afcbf305c0b4ae86, user_id=e1d07f55556444299c731134c38989cf, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:19.895358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:19.910179 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1303/2613] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:19 2022] PUT /identity/v3/projects/d9c4316949ac4ee5afcbf305c0b4ae86/users/e1d07f55556444299c731134c38989cf/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:19.920516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:19.920801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:19.921073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:19.950604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] MFA Rules not processed for user `e1d07f55556444299c731134c38989cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:19.951887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:20.024567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1311/2614] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:20.029291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.094048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50f59-ddff-469f-ae13-13deab413c55 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.099898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.100498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.100773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.101033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.101653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.103775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.132961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1304/2615] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:20 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:20.137055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.148023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c601d-2ff0-4ed6-a1a4-a84786f25c3e None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.210209 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.210851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.211133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.211402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.212395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.214339 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.236583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1312/2616] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:20 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:20.240686 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.251413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdecff-9024-439f-9d3a-50e28d495f76 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.256269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.256868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.257148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.257420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.258066 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.259713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.264985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:20.270944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1305/2617] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:20.275505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.285780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de244-64bf-44d0-8c91-e346b358d18d admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.290834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.291474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.291747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.292015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] PATH_INFO: `/v3/projects/c4bd2fcdc73447b8bd1704ce2b844e39/users/33b000f8bc3143089f6455aebe69b6a0/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.306943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bd2fcdc73447b8bd1704ce2b844e39, user_id=33b000f8bc3143089f6455aebe69b6a0, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.309580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.323663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1313/2618] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:20 2022] PUT /identity/v3/projects/c4bd2fcdc73447b8bd1704ce2b844e39/users/33b000f8bc3143089f6455aebe69b6a0/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:20.328207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.343340 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eefa0b-8ce3-4d89-ba0f-d0d626ae1bcf admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.407235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309b8a8-faeb-4484-aed6-9eb5d6a22f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.407583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b8a8-faeb-4484-aed6-9eb5d6a22f52 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.407881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b8a8-faeb-4484-aed6-9eb5d6a22f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.408169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b8a8-faeb-4484-aed6-9eb5d6a22f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.408863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309b8a8-faeb-4484-aed6-9eb5d6a22f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.410704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309b8a8-faeb-4484-aed6-9eb5d6a22f52 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.422164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1306/2619] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:20.426473 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.437333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598de1-1b55-4c8e-8cfb-ea3ea879c8cc admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.442412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.443133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.443414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.443689 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] PATH_INFO: `/v3/projects/c4bd2fcdc73447b8bd1704ce2b844e39/users/33b000f8bc3143089f6455aebe69b6a0/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.445749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bd2fcdc73447b8bd1704ce2b844e39, user_id=33b000f8bc3143089f6455aebe69b6a0, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.448487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.458910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1314/2620] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:20 2022] PUT /identity/v3/projects/c4bd2fcdc73447b8bd1704ce2b844e39/users/33b000f8bc3143089f6455aebe69b6a0/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:20.470381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.470674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.470983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.500030 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] MFA Rules not processed for user `33b000f8bc3143089f6455aebe69b6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:20.501247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:20.578283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1307/2621] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:20.649537 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:20.651665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:20.685834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:20.714261 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363c45-5254-4bed-afa7-53da9b1ddffb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:20.718659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:20.719305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:20.719563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:20.719825 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:20.729956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:20.731394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:20.741258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1315/2622] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:21.068953 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:21.078346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65864cb0-e736-4a1a-b873-6ea9d9f7d819 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:21.083730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b000f8bc3143089f6455aebe69b6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:21.084336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.084620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.084893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:21.085541 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:21.085844 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:21.087869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:21.099835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1308/2623] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:21.103962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:21.113488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ebe99-f195-4295-a7da-655d58d06df0 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:21.118577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b000f8bc3143089f6455aebe69b6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:21.119205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.119484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.119756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:21.120383 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:21.122289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:21.156236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1316/2624] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:21 2022] POST /identity/v3/projects => generated 354 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:21.160531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:21.170468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90768edc-dd50-4533-933a-60335abe01d1 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:21.228841 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b000f8bc3143089f6455aebe69b6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:21.229455 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.229736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.230007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:21.230653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:21.230994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:21.232607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:21.246554 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1309/2625] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:21.285545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:21.296719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dc188-f809-435f-9c28-db3124426097 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:21.302450 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b000f8bc3143089f6455aebe69b6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:21.303257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.303551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.303803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] PATH_INFO: `/v3/projects/d765b0931d994b2892376444e8e044b4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:21.305080 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d765b0931d994b2892376444e8e044b4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:21.307037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:21.365709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd765b0931d994b2892376444e8e044b4', 'request_id': 'req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.371792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd765b0931d994b2892376444e8e044b4', 'request_id': 'req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.380430 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd765b0931d994b2892376444e8e044b4', 'request_id': 'req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.392178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] The token cache is being invalidate because project d765b0931d994b2892376444e8e044b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:21.392498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.393159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9ad18adb-bd2c-4bc4-aea3-e2cf51c9cd14 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.394645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1317/2626] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:21 2022] DELETE /identity/v3/projects/d765b0931d994b2892376444e8e044b4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:21.605947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:21.607856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:21.613861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:21.675579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eecff-289f-4e7a-a8b1-937fe26d1f61 tempest-VolumeQuotaClassesTest-1525214662 tempest-VolumeQuotaClassesTest-1525214662-project-admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:21.733041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:21.733671 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.733946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.734212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] PATH_INFO: `/v3/users/e1d07f55556444299c731134c38989cf` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:21.735353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d07f55556444299c731134c38989cf)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:21.737308 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:21.785468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d07f55556444299c731134c38989cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.786024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d07f55556444299c731134c38989cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.792983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d07f55556444299c731134c38989cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.804899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d07f55556444299c731134c38989cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.805544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d07f55556444299c731134c38989cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:21.820094 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1310/2627] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:21 2022] DELETE /identity/v3/users/e1d07f55556444299c731134c38989cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:21.824949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.825499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.825499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:21.845659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:21.846878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:21.916384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1318/2628] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:21.926242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:21.927827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:21.960670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:21.989166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab4792-c486-46af-a382-8452ae6ec844 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:21.993079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:21.993715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:21.993944 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:21.994217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:22.003934 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:22.005367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:22.015516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1311/2629] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:22.312704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:22.314179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:22.326068 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e12ed-aa83-4ebc-b27f-d6f5c57dba2d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:22.331325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:22.331965 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:22.332235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:22.332499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] PATH_INFO: `/v3/projects/d9c4316949ac4ee5afcbf305c0b4ae86` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:22.334023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c4316949ac4ee5afcbf305c0b4ae86)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:22.335571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:22.369389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:22.385811 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c4316949ac4ee5afcbf305c0b4ae86', 'request_id': 'req-6c2a9362-394e-47bd-80d8-a4c4779030b5'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.391219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c4316949ac4ee5afcbf305c0b4ae86', 'request_id': 'req-6c2a9362-394e-47bd-80d8-a4c4779030b5'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.398911 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c4316949ac4ee5afcbf305c0b4ae86', 'request_id': 'req-6c2a9362-394e-47bd-80d8-a4c4779030b5'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.410849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] The token cache is being invalidate because project d9c4316949ac4ee5afcbf305c0b4ae86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:22.411141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.411901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.413527 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1319/2630] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:22 2022] DELETE /identity/v3/projects/d9c4316949ac4ee5afcbf305c0b4ae86 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:22.417745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:22.427883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd45699-5485-42e5-82c8-16c3c51e4f26 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:22.487716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:22.488344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:22.488600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:22.488892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] PATH_INFO: `/v3/users/33b000f8bc3143089f6455aebe69b6a0` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:22.490106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b000f8bc3143089f6455aebe69b6a0)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:22.492068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:22.544745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b000f8bc3143089f6455aebe69b6a0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.545524 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b000f8bc3143089f6455aebe69b6a0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.553079 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b000f8bc3143089f6455aebe69b6a0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.565917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b000f8bc3143089f6455aebe69b6a0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.566517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a551af6b-9f51-4478-bc82-265dc74d0b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b000f8bc3143089f6455aebe69b6a0'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:22.581299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1312/2631] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:22 2022] DELETE /identity/v3/users/33b000f8bc3143089f6455aebe69b6a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:22.863514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:22.865082 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:22.878877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9362-394e-47bd-80d8-a4c4779030b5 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:22.948090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:22.948743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:22.949054 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:22.949325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] PATH_INFO: `/v3/projects/c4bd2fcdc73447b8bd1704ce2b844e39` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:22.950549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bd2fcdc73447b8bd1704ce2b844e39)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:22.952639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.000648 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'request_id': 'req-5b855314-6619-4c99-8281-2f232e55e54b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:23.006270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'request_id': 'req-5b855314-6619-4c99-8281-2f232e55e54b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:23.014868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bd2fcdc73447b8bd1704ce2b844e39', 'request_id': 'req-5b855314-6619-4c99-8281-2f232e55e54b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:23.026624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] The token cache is being invalidate because project c4bd2fcdc73447b8bd1704ce2b844e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:23.026933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:23.027590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-5b855314-6619-4c99-8281-2f232e55e54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:23.029158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1320/2632] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:22 2022] DELETE /identity/v3/projects/c4bd2fcdc73447b8bd1704ce2b844e39 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:23.034587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.035123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.035218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.055463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:23.056669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:23.105904 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:23.123182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1313/2633] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:23.131046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.131326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.131593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.152289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:23.153523 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:23.163263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1321/2634] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:23.168180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.184362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67b66c-c012-4625-80f6-ef45574ee0b5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.199251 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.199894 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.200136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.200410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.201080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:23.201396 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.212207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.229806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1314/2635] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:23.237305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.247668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba496252-5ebb-42a4-83ff-f13c42ed9be4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.252854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.253460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.253737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.254004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.254629 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.256762 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.288201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1322/2636] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:23 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:23.292963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.303905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f0e46-3d25-45ea-b9b8-9931532f6dce admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.370572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.371148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.371427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.371697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.372322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.374259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.397828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1315/2637] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:23 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:23.402167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.413142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe462-2580-4ccf-aeb8-935773353ede admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.418240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.418878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.419173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.419427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.420076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.421723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.432169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1323/2638] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:23.436149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.446983 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61a25-55de-4d3c-ac98-3eccae23dc3e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.452812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1df38-07e6-41d0-9e85-301be20225f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.453409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1df38-07e6-41d0-9e85-301be20225f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.453690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1df38-07e6-41d0-9e85-301be20225f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.453960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1df38-07e6-41d0-9e85-301be20225f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.454639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1df38-07e6-41d0-9e85-301be20225f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.456286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1df38-07e6-41d0-9e85-301be20225f7 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.467034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1316/2639] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:23.471264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.478170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:23.482588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa016-8d8d-4ba6-9796-ac224a738d9c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.489092 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.489952 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.490371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.490720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] PATH_INFO: `/v3/projects/2ca819317b454ecd8a7985700978f2fc/users/da08d55ba1cd4f56b32f30108fbfb53d/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.505720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca819317b454ecd8a7985700978f2fc, user_id=da08d55ba1cd4f56b32f30108fbfb53d, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.508421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.523313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1324/2640] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:23 2022] PUT /identity/v3/projects/2ca819317b454ecd8a7985700978f2fc/users/da08d55ba1cd4f56b32f30108fbfb53d/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:23.533973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.534258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.534532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.701677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] MFA Rules not processed for user `da08d55ba1cd4f56b32f30108fbfb53d`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:23.703106 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:23.776559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1317/2641] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:23.788206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.789999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:23.854237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5a53-b28c-44cc-bda2-906bffaeecc1 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.858288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019d1d4-171c-41d6-bd99-506a562a3892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.858997 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019d1d4-171c-41d6-bd99-506a562a3892 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.859275 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019d1d4-171c-41d6-bd99-506a562a3892 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.859560 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019d1d4-171c-41d6-bd99-506a562a3892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.869263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019d1d4-171c-41d6-bd99-506a562a3892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.870737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019d1d4-171c-41d6-bd99-506a562a3892 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:23.880318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1325/2642] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:23.906089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:23.958582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:23.975874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704e633-01f4-4e26-b923-f6859fff4728 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:23.980730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:23.981363 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:23.981640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:23.981910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] PATH_INFO: `/v3/users/da08d55ba1cd4f56b32f30108fbfb53d` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:23.983076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da08d55ba1cd4f56b32f30108fbfb53d)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:23.985005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:24.037336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da08d55ba1cd4f56b32f30108fbfb53d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.038000 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da08d55ba1cd4f56b32f30108fbfb53d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.044768 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da08d55ba1cd4f56b32f30108fbfb53d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.057352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da08d55ba1cd4f56b32f30108fbfb53d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.058056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da08d55ba1cd4f56b32f30108fbfb53d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.073040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1318/2643] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:23 2022] DELETE /identity/v3/users/da08d55ba1cd4f56b32f30108fbfb53d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:24.077654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.077941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.078211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.098856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:24.100070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:24.160696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1326/2644] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:24.170709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:24.172185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:24.234581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044206b6-a2ca-4bdd-9e9b-6a44f5bb5a71 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:24.238914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed1e30-1b0b-44bb-a5c7-a5088ed51c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:24.239518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed1e30-1b0b-44bb-a5c7-a5088ed51c0e service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.239794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed1e30-1b0b-44bb-a5c7-a5088ed51c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.240087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed1e30-1b0b-44bb-a5c7-a5088ed51c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.249745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed1e30-1b0b-44bb-a5c7-a5088ed51c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:24.251223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed1e30-1b0b-44bb-a5c7-a5088ed51c0e service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:24.261171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1319/2645] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:24.556192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:24.557636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:24.569773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03697421-1e99-42fe-8ae5-f29f75f41c4b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:24.574470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:24.575142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.575420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.575728 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] PATH_INFO: `/v3/projects/2ca819317b454ecd8a7985700978f2fc` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.576926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca819317b454ecd8a7985700978f2fc)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:24.578986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:24.627095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca819317b454ecd8a7985700978f2fc', 'request_id': 'req-77a509bd-e65e-4080-bf4a-7dd215274186'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.633594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca819317b454ecd8a7985700978f2fc', 'request_id': 'req-77a509bd-e65e-4080-bf4a-7dd215274186'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.642274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca819317b454ecd8a7985700978f2fc', 'request_id': 'req-77a509bd-e65e-4080-bf4a-7dd215274186'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.654286 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] The token cache is being invalidate because project 2ca819317b454ecd8a7985700978f2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:24.654572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.655413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-77a509bd-e65e-4080-bf4a-7dd215274186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:24.657015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1327/2646] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:24 2022] DELETE /identity/v3/projects/2ca819317b454ecd8a7985700978f2fc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:24.662084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.667113 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.667402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.689591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:24.690868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:24.765800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1320/2647] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:24.775181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.775466 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.775737 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.790617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:24.796632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:24.798742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:24.807194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1328/2648] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:24.811647 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:24.821746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0b34-2b67-4840-a760-2d2e0bf324dd None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:24.827700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:24.828296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.828570 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.828832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.829481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:24.829777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:24.831409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:24.833729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:24.846754 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1321/2649] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:24.849778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:24.859729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6723900-9c22-41a6-9844-41ab9abf5cd3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:24.865826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:24.866427 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.866740 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.867009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.867639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:24.869558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:24.900205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1329/2650] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:24 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:24.905196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:24.917303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6c53a-5fcb-4c19-9f8f-275e82d7ff6b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:24.976518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:24.977138 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:24.977415 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:24.977686 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:24.978375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:24.980319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:25.005890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1322/2651] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:24 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:57:25.010366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:25.021418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77209efe-bb73-434b-b522-b14e2d342524 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:25.026717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:25.027321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:25.028263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:25.028528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:25.029175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:25.030889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:25.041011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1330/2652] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:25.045212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:25.055484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb82288-4d6b-4fbc-8ea5-fc775ac8d188 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:25.060387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8033da-74fc-4848-a51d-a836a63b6bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:25.060981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8033da-74fc-4848-a51d-a836a63b6bdc admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:25.061258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8033da-74fc-4848-a51d-a836a63b6bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:25.061526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8033da-74fc-4848-a51d-a836a63b6bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:25.062171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8033da-74fc-4848-a51d-a836a63b6bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:25.063804 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8033da-74fc-4848-a51d-a836a63b6bdc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:25.073584 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1323/2653] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:25.077774 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:25.088731 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed492-5650-40e2-913e-7c8530a607f9 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:25.094441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:25.095256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:25.095531 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:25.095802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] PATH_INFO: `/v3/projects/f382eef7cf414b19ad72c947e29a200b/users/147fe1742af84aeaba6b2d1814e9cb92/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:25.111330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f382eef7cf414b19ad72c947e29a200b, user_id=147fe1742af84aeaba6b2d1814e9cb92, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:25.113982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:25.129147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1331/2654] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:25 2022] PUT /identity/v3/projects/f382eef7cf414b19ad72c947e29a200b/users/147fe1742af84aeaba6b2d1814e9cb92/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:25.140468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f3cf-5015-4d26-b945-dc352f293964 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:25.140756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f3cf-5015-4d26-b945-dc352f293964 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:25.141029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f3cf-5015-4d26-b945-dc352f293964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:25.172098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-ac88f3cf-5015-4d26-b945-dc352f293964 None None] MFA Rules not processed for user `147fe1742af84aeaba6b2d1814e9cb92`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:25.173352 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ac88f3cf-5015-4d26-b945-dc352f293964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:25.247412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1324/2655] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:25.261795 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:25.264634 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:25.331854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12fc9-6b97-4223-a2ba-10a61b5b4e01 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:25.336490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:25.337475 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:25.337748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:25.338013 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:25.347248 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:25.348697 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:25.357587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1332/2656] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:26.756935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dad45b-7aa5-4675-9f0a-715968827cf2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:26.757464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dad45b-7aa5-4675-9f0a-715968827cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:26.757464 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dad45b-7aa5-4675-9f0a-715968827cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:26.777315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-86dad45b-7aa5-4675-9f0a-715968827cf2 None None] MFA Rules not processed for user `147fe1742af84aeaba6b2d1814e9cb92`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:26.778532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-86dad45b-7aa5-4675-9f0a-715968827cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:26.786320 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1325/2657] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:35.353587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:36.771995 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:43.733167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:43.735250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:43.797289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1185-95a1-45fb-8020-f7e26abc4405 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:43.801677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:43.802277 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:43.802549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:43.802861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:43.804957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:43.873321 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:43.874777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:43.884768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1333/2658] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:44.536642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667514-4acf-42e8-a02a-8f9b7e636550 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:44.537156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667514-4acf-42e8-a02a-8f9b7e636550 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:44.537282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667514-4acf-42e8-a02a-8f9b7e636550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:44.557278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f4667514-4acf-42e8-a02a-8f9b7e636550 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:44.558507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f4667514-4acf-42e8-a02a-8f9b7e636550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:44.614479 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1326/2659] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:44.661067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:44.662517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:44.734827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb726-d6bd-46a4-9a2a-1732d753010f service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:44.740283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:44.740908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:44.741191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:44.741465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:44.750801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:44.759462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:44.768955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1334/2660] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:57:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:45.317694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408566ca-6833-4159-99c6-343e039519ce None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.317982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408566ca-6833-4159-99c6-343e039519ce None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.318252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408566ca-6833-4159-99c6-343e039519ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.337913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-408566ca-6833-4159-99c6-343e039519ce None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:45.339137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-408566ca-6833-4159-99c6-343e039519ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:45.346470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1327/2661] 10.222.0.49 () {58 vars in 967 bytes} [Tue Sep 6 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:45.358708 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:45.370009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb511-8435-4451-afbf-5b25f9b709de service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:45.375271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:45.375880 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.376200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.376470 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.384962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:45.386554 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:45.395732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1335/2662] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:45.645286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639547-0eda-404e-980a-e5498ed7b22d None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.645850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639547-0eda-404e-980a-e5498ed7b22d None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.646191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639547-0eda-404e-980a-e5498ed7b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.667707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c5639547-0eda-404e-980a-e5498ed7b22d None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:45.668958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c5639547-0eda-404e-980a-e5498ed7b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:45.676567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1328/2663] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:45.691185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:45.710361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cbd84-9782-4c4b-a34a-a25c81a0506d service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:45.717289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:45.719425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.719945 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.720424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.735268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:45.738423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:45.749421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1336/2664] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:46.135780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:46.136305 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:46.136838 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:46.158720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:46.160286 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:46.169510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1329/2665] 10.222.0.49 () {58 vars in 967 bytes} [Tue Sep 6 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:46.192950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:46.205000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c1b8-5f00-4b91-a9b2-8335441b5b8b service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:46.216794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:46.217419 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:46.217869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:46.218142 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:46.228220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:46.229816 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:46.234635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:46.239026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1337/2666] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:47.229837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:47.231964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:47.259096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be396da-9ed2-4e1d-9caa-6d2b2e3d15e1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:47.265774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:47.266650 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:47.267102 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:47.267427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] PATH_INFO: `/v3/users/3c995c3fcae24fffb1a3a2147a9d6d1a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:47.269096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c995c3fcae24fffb1a3a2147a9d6d1a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:47.271690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:47.335386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c995c3fcae24fffb1a3a2147a9d6d1a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.336038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c995c3fcae24fffb1a3a2147a9d6d1a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.343339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c995c3fcae24fffb1a3a2147a9d6d1a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.356974 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c995c3fcae24fffb1a3a2147a9d6d1a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.357662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-17a43a91-51f0-4443-b5b5-3ae902adcde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c995c3fcae24fffb1a3a2147a9d6d1a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.372091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1330/2667] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:47 2022] DELETE /identity/v3/users/3c995c3fcae24fffb1a3a2147a9d6d1a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:47.563694 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:47.576869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464170e-c9d9-423c-a4ad-b491babb04ad service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:47.639358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:47.639900 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:47.640179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:47.640449 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] PATH_INFO: `/v3/projects/d2c8a104404d4065aa01c083531e595b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:47.641570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c8a104404d4065aa01c083531e595b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:47.643517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:47.696971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c8a104404d4065aa01c083531e595b', 'request_id': 'req-456215ef-af70-4158-b864-0da53c9d4f11'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.703943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c8a104404d4065aa01c083531e595b', 'request_id': 'req-456215ef-af70-4158-b864-0da53c9d4f11'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.714484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c8a104404d4065aa01c083531e595b', 'request_id': 'req-456215ef-af70-4158-b864-0da53c9d4f11'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.727432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] The token cache is being invalidate because project d2c8a104404d4065aa01c083531e595b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:47.727719 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.728387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-456215ef-af70-4158-b864-0da53c9d4f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:47.729887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1338/2668] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:47 2022] DELETE /identity/v3/projects/d2c8a104404d4065aa01c083531e595b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:47.735093 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:47.735380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:47.735677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:47.759571 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:47.760939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:47.816750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:47.829567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1331/2669] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:47.838397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:47.838679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:47.838984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:47.859555 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:47.860779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:47.869933 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1339/2670] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:47.874392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:47.884459 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b09f83-9325-4f55-adf0-7ec498519b9c None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:47.890641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:47.891287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:47.891558 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:47.891842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:47.892477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:47.892770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:47.894369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:47.906865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1332/2671] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:57:47.911725 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:47.921157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c897-fcbf-4fe6-baac-b6cf3cb72f6b None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:47.926208 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:47.926844 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:47.927121 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:47.927389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:47.928019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:47.929916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:47.958581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1340/2672] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:47 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:57:47.963300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:47.973575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3933c9-9292-4032-add8-43d5aa678bf3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.029218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.029814 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.030091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.030354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.031018 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.032916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.055549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1333/2673] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:47 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:48.059748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.070381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2071b-3191-40bc-bb12-7eabb52f5232 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.075563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.076173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.076455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.076726 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.077372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.079072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.090792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1341/2674] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:48.094916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.105702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff434-1925-4d7a-8be7-173a9cc16869 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.114265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19198bc-e090-480e-b089-41e48b12cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.114920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19198bc-e090-480e-b089-41e48b12cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.115697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19198bc-e090-480e-b089-41e48b12cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.115697 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19198bc-e090-480e-b089-41e48b12cac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.116127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19198bc-e090-480e-b089-41e48b12cac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.117745 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19198bc-e090-480e-b089-41e48b12cac6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.129185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1334/2675] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:48.133706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.144428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab69c3-a05d-4df4-9b15-c4510be9e1d4 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.149913 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.150576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.150859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.151149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] PATH_INFO: `/v3/projects/10b596e9aa11498fb3f81eb29b34a377/users/e8afd8dbc1074d99b34345a7beb7a93e/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.166897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b596e9aa11498fb3f81eb29b34a377, user_id=e8afd8dbc1074d99b34345a7beb7a93e, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.169542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.188622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1342/2676] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:48 2022] PUT /identity/v3/projects/10b596e9aa11498fb3f81eb29b34a377/users/e8afd8dbc1074d99b34345a7beb7a93e/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:48.199854 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.200139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.200410 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.232100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] MFA Rules not processed for user `e8afd8dbc1074d99b34345a7beb7a93e`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:48.233964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.306975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1335/2677] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:48.312239 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.347456 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:48.381778 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651cdb8-15c9-48d2-b510-d733090f132b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.390077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.390704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.390983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.391252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.391901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.393848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.424598 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1343/2678] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:48 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:48.428892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.440170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778573-0c9d-44c9-a7fa-c5f6d1466a8f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.453994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.455690 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.490185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:48.500682 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.501338 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.501613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.501975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.502609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.504593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.521604 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1d05-a3fd-4b4a-b6c4-eef800db3a22 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.526599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1336/2679] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:48 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:48.526758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.527423 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.527761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.528096 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] PATH_INFO: `/v3/users/147fe1742af84aeaba6b2d1814e9cb92` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.529574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=147fe1742af84aeaba6b2d1814e9cb92)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.530324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.531775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.539837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fca2-b60f-44b2-a5e4-0fd62a6172a4 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.544461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.545365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.545365 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.545665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.546276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.548062 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.559220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1337/2680] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:48.563829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.574451 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b083-917b-482f-9551-c82acab3ef11 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.579318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.579972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.580248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.580596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] PATH_INFO: `/v3/projects/e059145cccff422cbb72155834a2bff3/users/d34ada4117c9432fbb4cd3fe2b52a0e3/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.581245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147fe1742af84aeaba6b2d1814e9cb92'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:48.581921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147fe1742af84aeaba6b2d1814e9cb92'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:48.589510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147fe1742af84aeaba6b2d1814e9cb92'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:48.595811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e059145cccff422cbb72155834a2bff3, user_id=d34ada4117c9432fbb4cd3fe2b52a0e3, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.598448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.602025 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147fe1742af84aeaba6b2d1814e9cb92'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:48.602805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-170022b7-14b6-4a77-9599-6a9e85a4e34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147fe1742af84aeaba6b2d1814e9cb92'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:48.611998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1338/2681] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:48 2022] PUT /identity/v3/projects/e059145cccff422cbb72155834a2bff3/users/d34ada4117c9432fbb4cd3fe2b52a0e3/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:48.615960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.617718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.619167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1344/2682] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:48 2022] DELETE /identity/v3/users/147fe1742af84aeaba6b2d1814e9cb92 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:48.623263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.623536 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.623803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.642569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:48.643786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.670053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:48.681255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5006a-3ad4-4faa-99f8-72210281fa08 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.705893 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1345/2683] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:48.717117 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.718720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.737312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.737955 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.738255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.738493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.739222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.740865 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.750976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1339/2684] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:48.755027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.764598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305278aa-b847-4793-ac7a-b33d106752b1 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.769069 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77115d-5b30-49cc-aeff-bfa8ccf66988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.769710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77115d-5b30-49cc-aeff-bfa8ccf66988 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.769985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77115d-5b30-49cc-aeff-bfa8ccf66988 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.770265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77115d-5b30-49cc-aeff-bfa8ccf66988 admin admin] PATH_INFO: `/v3/projects/e059145cccff422cbb72155834a2bff3/users/d34ada4117c9432fbb4cd3fe2b52a0e3/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.772205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77115d-5b30-49cc-aeff-bfa8ccf66988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e059145cccff422cbb72155834a2bff3, user_id=d34ada4117c9432fbb4cd3fe2b52a0e3, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.774906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77115d-5b30-49cc-aeff-bfa8ccf66988 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.777710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d66766-2b6f-459d-b22a-f038b476760f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.781712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:48.782311 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.782583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.782886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.785399 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1340/2685] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:48 2022] PUT /identity/v3/projects/e059145cccff422cbb72155834a2bff3/users/d34ada4117c9432fbb4cd3fe2b52a0e3/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:48.795020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:48.795020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:48.797224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:48.797520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:48.797791 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:48.803444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1346/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:57:48.826240 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] MFA Rules not processed for user `d34ada4117c9432fbb4cd3fe2b52a0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:48.827501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.855110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:48.900642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1341/2687] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:48.911211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.912782 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:48.972802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cca7e-0798-4ded-9113-97ef053d7138 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:48.982322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:48.983777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:49.033422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:49.034033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:49.034305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:49.034567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:49.043871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:49.045326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:49.055211 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1347/2688] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:49.055921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9305-3868-4a13-903f-0fdbcada9717 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:49.060675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:49.061348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:49.061626 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:49.061890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] PATH_INFO: `/v3/projects/f382eef7cf414b19ad72c947e29a200b` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:49.063043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f382eef7cf414b19ad72c947e29a200b)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:49.064967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:49.112784 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f382eef7cf414b19ad72c947e29a200b', 'request_id': 'req-b68de4c2-4a3e-431b-be4a-9decb76462fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.118523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f382eef7cf414b19ad72c947e29a200b', 'request_id': 'req-b68de4c2-4a3e-431b-be4a-9decb76462fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.124816 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f382eef7cf414b19ad72c947e29a200b', 'request_id': 'req-b68de4c2-4a3e-431b-be4a-9decb76462fc'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.139127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] The token cache is being invalidate because project f382eef7cf414b19ad72c947e29a200b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:49.140016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.140258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b68de4c2-4a3e-431b-be4a-9decb76462fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.141976 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1342/2689] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:48 2022] DELETE /identity/v3/projects/f382eef7cf414b19ad72c947e29a200b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:49.641974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:49.653161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588c6e7-6b8f-4f6d-8b12-afed59d96c6c service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:49.685681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:49.716252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:49.716873 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:49.717148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:49.717417 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] PATH_INFO: `/v3/users/e8afd8dbc1074d99b34345a7beb7a93e` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:49.718642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8afd8dbc1074d99b34345a7beb7a93e)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:49.720594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:49.783024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8afd8dbc1074d99b34345a7beb7a93e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.783768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8afd8dbc1074d99b34345a7beb7a93e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.794898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8afd8dbc1074d99b34345a7beb7a93e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.811118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8afd8dbc1074d99b34345a7beb7a93e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.811826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8afd8dbc1074d99b34345a7beb7a93e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:49.826429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1348/2690] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:49 2022] DELETE /identity/v3/users/e8afd8dbc1074d99b34345a7beb7a93e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:49.831347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:49.831956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:49.831956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:49.851460 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:49.852640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:49.900629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:49.913925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1343/2691] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:49.923860 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:49.925380 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:49.987805 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ff791-8e31-4d0f-bea7-c6b8668701ad admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:49.992114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:49.992718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:49.992995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:49.993263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:50.003395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:50.004843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:50.014785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1349/2692] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:50.293433 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:50.295107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:50.307885 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454de52-07f5-4be5-a117-7f2386ba6650 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:50.313005 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:50.313621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:50.313907 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:50.314170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] PATH_INFO: `/v3/projects/10b596e9aa11498fb3f81eb29b34a377` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:50.315789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b596e9aa11498fb3f81eb29b34a377)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:50.318076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:50.366277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b596e9aa11498fb3f81eb29b34a377', 'request_id': 'req-ed71b2af-bec6-492f-b212-d987ebaa84a9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.371774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b596e9aa11498fb3f81eb29b34a377', 'request_id': 'req-ed71b2af-bec6-492f-b212-d987ebaa84a9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.377773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b596e9aa11498fb3f81eb29b34a377', 'request_id': 'req-ed71b2af-bec6-492f-b212-d987ebaa84a9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.391163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] The token cache is being invalidate because project 10b596e9aa11498fb3f81eb29b34a377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:50.391475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.392082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.393533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1344/2693] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:50 2022] DELETE /identity/v3/projects/10b596e9aa11498fb3f81eb29b34a377 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:50.397608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:50.407823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225487fb-9790-428c-9080-8c606f365515 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:50.462730 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:50.471045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:50.471959 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:50.472288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:50.472702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] PATH_INFO: `/v3/users/d34ada4117c9432fbb4cd3fe2b52a0e3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:50.474413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34ada4117c9432fbb4cd3fe2b52a0e3)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:50.476791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:50.525530 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34ada4117c9432fbb4cd3fe2b52a0e3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.526187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34ada4117c9432fbb4cd3fe2b52a0e3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.533161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34ada4117c9432fbb4cd3fe2b52a0e3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.545760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34ada4117c9432fbb4cd3fe2b52a0e3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.546480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d740863-69d4-4713-bb2b-c8fe2639e9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34ada4117c9432fbb4cd3fe2b52a0e3'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.560921 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1350/2694] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:50 2022] DELETE /identity/v3/users/d34ada4117c9432fbb4cd3fe2b52a0e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:50.845477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:50.847191 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:50.862879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71b2af-bec6-492f-b212-d987ebaa84a9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:50.923490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:50.924050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:50.924329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:50.924603 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] PATH_INFO: `/v3/projects/e059145cccff422cbb72155834a2bff3` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:50.925795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e059145cccff422cbb72155834a2bff3)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:50.927747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:50.977483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e059145cccff422cbb72155834a2bff3', 'request_id': 'req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.983080 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e059145cccff422cbb72155834a2bff3', 'request_id': 'req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:50.989170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e059145cccff422cbb72155834a2bff3', 'request_id': 'req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:51.003129 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] The token cache is being invalidate because project e059145cccff422cbb72155834a2bff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:51.003412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:51.004040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-9a6db6f5-f4af-4080-8c65-45cc2ddc5c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:51.005517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1345/2695] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:50 2022] DELETE /identity/v3/projects/e059145cccff422cbb72155834a2bff3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:51.010610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.011165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.011165 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.031915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:51.033135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:51.095146 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1351/2696] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:51.103420 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.103706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.103973 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.119172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:51.125510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:51.127529 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:51.136747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1346/2697] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:51.140996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.151594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658454d9-5e28-45af-acd6-651a60a3f892 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.156801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.157396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.157672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.157940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.158591 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:51.158950 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.160557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.172264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1352/2698] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:57:51.176748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.186253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec173f-617c-4304-b466-b335d3b88c87 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.191997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.192599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.192895 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.193168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.193795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.195744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.228289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1347/2699] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:51 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:51.232791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.243226 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde73d-ed33-4cea-a887-2854408107dd admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.300140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.300745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.300992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.301288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.301912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.303869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.313104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:51.328168 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1353/2700] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:51 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:51.332608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.344013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93a80-aba4-4697-9fdf-469bfd837091 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.349521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.350123 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.350402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.350732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.351380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.352972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.363256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1348/2701] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:51.368472 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.382974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6bc59-cc9d-431a-b5aa-cc95d6175a44 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.391435 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32947875-b344-48ae-9db7-f79f55779f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.392222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32947875-b344-48ae-9db7-f79f55779f05 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.392563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32947875-b344-48ae-9db7-f79f55779f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.392923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32947875-b344-48ae-9db7-f79f55779f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.393886 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32947875-b344-48ae-9db7-f79f55779f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.396436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32947875-b344-48ae-9db7-f79f55779f05 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.407336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1354/2702] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:51.411557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.421821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc650e-3a64-44bb-9f2c-12f9ca86b834 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.427874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.428456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.428729 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.429038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] PATH_INFO: `/v3/projects/f7245c0f77a1454785e7068e7c4eba23/users/d040d5cd71c64326b729ca49f9145e31/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.444692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7245c0f77a1454785e7068e7c4eba23, user_id=d040d5cd71c64326b729ca49f9145e31, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.447376 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.463283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1349/2703] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:51 2022] PUT /identity/v3/projects/f7245c0f77a1454785e7068e7c4eba23/users/d040d5cd71c64326b729ca49f9145e31/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:51.473960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.474241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.474517 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.503802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] MFA Rules not processed for user `d040d5cd71c64326b729ca49f9145e31`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:51.505027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:51.572242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1355/2704] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:57:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:51.583750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:51.585778 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:51.644572 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250cf1-b37e-4b84-bd72-389ed642dee6 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:51.648501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0368-efe1-4a1a-84c6-f22bb1fb5933 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:51.649101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0368-efe1-4a1a-84c6-f22bb1fb5933 service glance] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:51.649374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0368-efe1-4a1a-84c6-f22bb1fb5933 service glance] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:51.649638 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0368-efe1-4a1a-84c6-f22bb1fb5933 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:51.657975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0368-efe1-4a1a-84c6-f22bb1fb5933 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:51.659476 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0368-efe1-4a1a-84c6-f22bb1fb5933 service glance] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:51.668719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1350/2705] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:01.569332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:01.664349 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:11.617335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:11.683072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8512f89-7087-4a6c-a08e-1063a32dc7b6 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:11.688505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:11.689130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:11.689408 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:11.689679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] PATH_INFO: `/v3/users/d040d5cd71c64326b729ca49f9145e31` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:11.690941 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d040d5cd71c64326b729ca49f9145e31)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:11.692868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:11.744229 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd040d5cd71c64326b729ca49f9145e31'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:11.744923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd040d5cd71c64326b729ca49f9145e31'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:11.752003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd040d5cd71c64326b729ca49f9145e31'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:11.763960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd040d5cd71c64326b729ca49f9145e31'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:11.764642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd040d5cd71c64326b729ca49f9145e31'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:11.778287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1356/2706] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:11 2022] DELETE /identity/v3/users/d040d5cd71c64326b729ca49f9145e31 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:11.783283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:11.783800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:11.783800 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:11.805690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:11.806964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:11.868565 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1351/2707] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:58:11.878601 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:11.880301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:11.940833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765a7c-fab7-41ad-bba3-53d869e9258a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:11.944722 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33586f34-072f-4878-83df-f1abb7345bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:11.945324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586f34-072f-4878-83df-f1abb7345bbd service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:11.945599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586f34-072f-4878-83df-f1abb7345bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:11.945868 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586f34-072f-4878-83df-f1abb7345bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:11.955315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33586f34-072f-4878-83df-f1abb7345bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:11.956745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33586f34-072f-4878-83df-f1abb7345bbd service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:11.967338 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1357/2708] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:12.242807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.244275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:12.257906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201468ed-35b6-46c7-8f5f-ae4679e0fab5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.264302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.265110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.265386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.265670 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] PATH_INFO: `/v3/projects/f7245c0f77a1454785e7068e7c4eba23` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.266869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7245c0f77a1454785e7068e7c4eba23)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.268749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.318471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7245c0f77a1454785e7068e7c4eba23', 'request_id': 'req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:12.324091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7245c0f77a1454785e7068e7c4eba23', 'request_id': 'req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:12.330141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7245c0f77a1454785e7068e7c4eba23', 'request_id': 'req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:12.345101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] The token cache is being invalidate because project f7245c0f77a1454785e7068e7c4eba23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:12.345373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:12.345981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-95e6c9f2-30b8-45b8-bd6e-41404dc9f952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:12.347502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1352/2709] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:12 2022] DELETE /identity/v3/projects/f7245c0f77a1454785e7068e7c4eba23 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:12.352583 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.352870 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.353139 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.372545 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:12.373744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:12.390676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:12.437030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1358/2710] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:12.445148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.445430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.445717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.466450 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:12.467710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:12.476232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1353/2711] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:12.480765 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.491166 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed798dc-e218-4bd5-b26a-69a4c7651004 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.497108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.497716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.497994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.498291 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.498981 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:58:12.499287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.500891 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.513154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1359/2712] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:58:12.517562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.527350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb017169-2277-48dd-b71c-68d4c5c187ca None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.532842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.533446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.533724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.533994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.534631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.536546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.576237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1354/2713] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:12 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:12.582451 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.595062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70323-5c1a-45ba-8723-8062ffbd2364 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.654172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.654915 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.655056 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.655353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.655985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.657931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.681691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1360/2714] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:12 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:12.686025 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.696979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e2cb-5399-4574-8c5f-d3ee15b04c9a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.702051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.702656 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.702980 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.703252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.703906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.705539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.718578 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1355/2715] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:12.722581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.733099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a00cce-a6f0-4957-b044-644a4451d62a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.738198 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a10f5a-e439-48f0-8972-b05d05810d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.738821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a10f5a-e439-48f0-8972-b05d05810d49 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.739097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a10f5a-e439-48f0-8972-b05d05810d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.739375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a10f5a-e439-48f0-8972-b05d05810d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.740015 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a10f5a-e439-48f0-8972-b05d05810d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.741617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a10f5a-e439-48f0-8972-b05d05810d49 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.752771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1361/2716] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:12.757031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.767619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7379-3605-4b15-97cf-734fe021d6ee admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:12.773220 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:12.773880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.774156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.774512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] PATH_INFO: `/v3/projects/c235041b2ffe478b95085266fa18b84f/users/7d5fcfb426ec45debe4f5a3b0f92fcc4/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.791035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c235041b2ffe478b95085266fa18b84f, user_id=7d5fcfb426ec45debe4f5a3b0f92fcc4, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:12.793675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:12.809155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1356/2717] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:12 2022] PUT /identity/v3/projects/c235041b2ffe478b95085266fa18b84f/users/7d5fcfb426ec45debe4f5a3b0f92fcc4/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:12.819779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:12.820066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:12.820352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:12.848882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] MFA Rules not processed for user `7d5fcfb426ec45debe4f5a3b0f92fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:12.850100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:12.915797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1362/2718] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:12.927380 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:12.929256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:12.943103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:13.001651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d417116-1481-4d96-8142-05e45a19217d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:13.006631 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507cbf4-8f3b-4c95-9136-802c5befe495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:13.007281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507cbf4-8f3b-4c95-9136-802c5befe495 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:13.007560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507cbf4-8f3b-4c95-9136-802c5befe495 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:13.007833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507cbf4-8f3b-4c95-9136-802c5befe495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:13.017604 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507cbf4-8f3b-4c95-9136-802c5befe495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:13.019074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507cbf4-8f3b-4c95-9136-802c5befe495 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:13.028653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1357/2719] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:22.912384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:23.024068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=21 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:25.657908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:25.723574 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9833f-e0dc-4661-98da-1a31b0ac5f57 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:25.729123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:25.729766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:25.730044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:25.730315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] PATH_INFO: `/v3/users/7d5fcfb426ec45debe4f5a3b0f92fcc4` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:25.731490 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5fcfb426ec45debe4f5a3b0f92fcc4)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:25.733478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:25.781375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5fcfb426ec45debe4f5a3b0f92fcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:25.781958 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5fcfb426ec45debe4f5a3b0f92fcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:25.789181 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5fcfb426ec45debe4f5a3b0f92fcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:25.800852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5fcfb426ec45debe4f5a3b0f92fcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:25.801485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5fcfb426ec45debe4f5a3b0f92fcc4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:25.816375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1363/2720] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:25 2022] DELETE /identity/v3/users/7d5fcfb426ec45debe4f5a3b0f92fcc4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:25.821781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:25.822364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:25.822364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:25.845351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:25.846561 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:25.915189 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1358/2721] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:25.925132 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:25.926823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:25.989454 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2cf33-0230-4d10-995a-8f8989f62fc6 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:25.993833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe250-4205-4faa-a15e-da3f48f52188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:25.994462 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe250-4205-4faa-a15e-da3f48f52188 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:25.994742 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe250-4205-4faa-a15e-da3f48f52188 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:25.995035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe250-4205-4faa-a15e-da3f48f52188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.005501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe250-4205-4faa-a15e-da3f48f52188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.006969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abe250-4205-4faa-a15e-da3f48f52188 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.016573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1364/2722] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:26.301291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.302819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:26.316506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647142d4-bcb1-4999-9072-2ebb8708476f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.321225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.321870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.322162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.322426 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] PATH_INFO: `/v3/projects/c235041b2ffe478b95085266fa18b84f` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.323819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c235041b2ffe478b95085266fa18b84f)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.325799 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.377245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c235041b2ffe478b95085266fa18b84f', 'request_id': 'req-733d4fdd-763f-4ac1-b405-204d12e36041'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:26.382880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c235041b2ffe478b95085266fa18b84f', 'request_id': 'req-733d4fdd-763f-4ac1-b405-204d12e36041'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:26.389248 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c235041b2ffe478b95085266fa18b84f', 'request_id': 'req-733d4fdd-763f-4ac1-b405-204d12e36041'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:26.403938 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] The token cache is being invalidate because project c235041b2ffe478b95085266fa18b84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:26.404229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:26.404861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-733d4fdd-763f-4ac1-b405-204d12e36041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:26.406394 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1359/2723] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:26 2022] DELETE /identity/v3/projects/c235041b2ffe478b95085266fa18b84f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:26.411624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.411914 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.412187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.432075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:26.433294 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:26.450663 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:26.500193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1365/2724] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:26.509348 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.509575 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.509882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.531628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:26.532806 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:26.541553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1360/2725] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:26.546158 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.558169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893c76-af6e-4b30-9549-4934722c4601 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.564732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.565358 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.565617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.565882 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.566534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:58:26.566864 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.568498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.580843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1366/2726] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:58:26.585335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.595245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7241b9-9a97-4a75-b78b-2d44529bcaa7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.601299 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.601915 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.602168 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.602481 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.603137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.605027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.635623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1361/2727] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:26 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:26.639916 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.650373 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2848d-a511-4c9f-9fb8-a5dad67418cb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.712371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.713483 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.713785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.714044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.714709 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.716621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.739189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1367/2728] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:26 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:26.743742 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.754407 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237b37-be27-48b3-8c76-91cf18725072 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.760306 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.760909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.761188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.761461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.762089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.763740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.774141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1362/2729] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:26.778421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.788777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8523-993e-4a37-ae30-88b2d0cfb51b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.793908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952489-4d8a-4be2-92a1-678ee23d4c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.794492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952489-4d8a-4be2-92a1-678ee23d4c10 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.794821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952489-4d8a-4be2-92a1-678ee23d4c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.795085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952489-4d8a-4be2-92a1-678ee23d4c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.795721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa952489-4d8a-4be2-92a1-678ee23d4c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.797376 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa952489-4d8a-4be2-92a1-678ee23d4c10 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.808157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1368/2730] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:26.812325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.822609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cfcd0-7255-438c-aa3d-96b0436a7d2e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:26.827965 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:26.828612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.828887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.829156 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] PATH_INFO: `/v3/projects/69db0f36e3b24d4d98976c2c5f633cd9/users/259f4fc53d754179bb2116d676f9ca93/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.844335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69db0f36e3b24d4d98976c2c5f633cd9, user_id=259f4fc53d754179bb2116d676f9ca93, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:26.847007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:26.862033 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1363/2731] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:26 2022] PUT /identity/v3/projects/69db0f36e3b24d4d98976c2c5f633cd9/users/259f4fc53d754179bb2116d676f9ca93/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:58:26.872590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:26.872845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:26.873169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:26.901381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] MFA Rules not processed for user `259f4fc53d754179bb2116d676f9ca93`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:26.902654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:26.970859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1369/2732] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:26.975633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:26.996923 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:27.040379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc5cf-f510-40b6-a804-a1615548689c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.045623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.046225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.046498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.046793 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.047482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.049321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.075857 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1364/2733] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:26 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:27.080061 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.091258 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2121d-ebe9-41b2-a2fd-350942745d59 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.103391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:27.151276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.151883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.152156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.152425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.153045 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.155024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.179357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1370/2734] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:27 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:27.183437 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.193949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea2f40-2476-4242-964f-0c3a718a4db9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.199553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.200142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.200879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.200879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.201296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.202937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.213963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1365/2735] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:27.217999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.229206 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203c585-c14c-4aba-9622-78500e45972b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.233932 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c78aa-ca0a-4c8d-81a3-5eedcdb499b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.234533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c78aa-ca0a-4c8d-81a3-5eedcdb499b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.234854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c78aa-ca0a-4c8d-81a3-5eedcdb499b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.235126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c78aa-ca0a-4c8d-81a3-5eedcdb499b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.235769 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c78aa-ca0a-4c8d-81a3-5eedcdb499b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.237381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c78aa-ca0a-4c8d-81a3-5eedcdb499b0 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.247503 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1371/2736] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:27.251598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.262048 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed7faa-3b09-47a6-9e76-ffa8cebec071 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.267669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.268317 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.268592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.268853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] PATH_INFO: `/v3/projects/d58fd7536efb45a39bbdeca619453a58/users/15e23a0f4e4d4c8a8f104d7a09b6453a/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.283567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58fd7536efb45a39bbdeca619453a58, user_id=15e23a0f4e4d4c8a8f104d7a09b6453a, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.286287 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.301795 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1366/2737] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:27 2022] PUT /identity/v3/projects/d58fd7536efb45a39bbdeca619453a58/users/15e23a0f4e4d4c8a8f104d7a09b6453a/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:58:27.313406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.313691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.313962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.347129 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] MFA Rules not processed for user `15e23a0f4e4d4c8a8f104d7a09b6453a`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:27.348418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:27.414108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1372/2738] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:27.418864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.486243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072746d6-a8bd-4178-97f1-b7bb9a5a55e9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.491467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.492068 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.492345 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.492612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.493232 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.495177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.523566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1367/2739] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:27 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:27.527828 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.539307 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b70d-f917-4322-a8c1-3368f3682ed8 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.606316 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.607126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.607476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.607857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.608823 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.611884 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.635066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1373/2740] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:27 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:58:27.639229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.650193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384a306-74dc-449f-9f83-3fc2daa5fb40 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.656082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.656685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.656961 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.657227 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.657898 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.659607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.671702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1368/2741] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:27.676114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.686982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cee81c-d942-4bd4-971d-d20658ac00cf admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.693557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.694463 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.694902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.695230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] PATH_INFO: `/v3/projects/5f8a3241d54f4d73874fededc4e6ef91/users/bdb02378b48e46379925041a04adb4aa/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.711879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:27.716303 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8a3241d54f4d73874fededc4e6ef91, user_id=bdb02378b48e46379925041a04adb4aa, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.720354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.734271 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1374/2742] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:27 2022] PUT /identity/v3/projects/5f8a3241d54f4d73874fededc4e6ef91/users/bdb02378b48e46379925041a04adb4aa/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:27.738339 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.748595 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280cfec-0541-4ef0-90a2-382618b48a75 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.803997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:27.821779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14be7a-66cc-4917-9e7d-69c3fc2bd65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.822409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14be7a-66cc-4917-9e7d-69c3fc2bd65a admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.822714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14be7a-66cc-4917-9e7d-69c3fc2bd65a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.823315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14be7a-66cc-4917-9e7d-69c3fc2bd65a admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.823609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14be7a-66cc-4917-9e7d-69c3fc2bd65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.825199 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14be7a-66cc-4917-9e7d-69c3fc2bd65a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.834966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1369/2743] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:27.839987 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:27.851076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456949-d14b-44ba-8ece-0d97bcbbe711 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:27.857100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:27.857705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.857974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.858242 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] PATH_INFO: `/v3/projects/5f8a3241d54f4d73874fededc4e6ef91/users/bdb02378b48e46379925041a04adb4aa/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.860635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8a3241d54f4d73874fededc4e6ef91, user_id=bdb02378b48e46379925041a04adb4aa, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:27.863325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:27.873994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1375/2744] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:27 2022] PUT /identity/v3/projects/5f8a3241d54f4d73874fededc4e6ef91/users/bdb02378b48e46379925041a04adb4aa/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:27.884991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:27.885292 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:27.885623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:27.920580 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] MFA Rules not processed for user `bdb02378b48e46379925041a04adb4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:27.921819 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:27.993522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1370/2745] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:28.005605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:28.007715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:28.068889 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28839e7e-03b9-40f6-914d-d577de16046b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:28.072985 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:28.073586 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:28.073865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:28.074134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:28.135850 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:28.137263 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:28.146862 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1376/2746] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:29.671692 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:29.673325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:29.687366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5b938-1724-444d-bbde-ee084b2d213f None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:29.691881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:29.692489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:29.692764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:29.693032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:29.761700 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:29.763167 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:29.772053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1371/2747] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:30.321237 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:30.330190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83823b1c-8389-4cb6-b3ea-e323f25d23bb service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:30.334534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:30.335169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:30.335440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:30.335710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:30.345309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:30.346775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:30.356433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1377/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:33.094775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:33.096303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:33.167914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc25078-8d16-46f5-8ca5-1ebf0bae422a service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:33.171719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:33.172354 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:33.172709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:33.172856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:33.174752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:33.192762 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:33.250046 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:33.251441 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f58230-17fa-4ad4-8907-a7c39c37ada1 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:33.262532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1372/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:34.301863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:34.379842 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4160f-b26c-42e8-a43a-d5debe51fb82 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:34.386126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:34.386792 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:34.387093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:34.387344 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] PATH_INFO: `/v3/users/259f4fc53d754179bb2116d676f9ca93` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:34.388631 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=259f4fc53d754179bb2116d676f9ca93)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:34.390576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:34.414110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:34.441679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259f4fc53d754179bb2116d676f9ca93'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:34.442332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259f4fc53d754179bb2116d676f9ca93'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:34.449457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259f4fc53d754179bb2116d676f9ca93'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:34.465505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259f4fc53d754179bb2116d676f9ca93'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:34.466250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259f4fc53d754179bb2116d676f9ca93'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:34.482796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1378/2750] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:34 2022] DELETE /identity/v3/users/259f4fc53d754179bb2116d676f9ca93 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:34.487501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:34.488012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:34.488012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:34.507309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:34.508515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:34.567164 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1373/2751] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:58:34.576814 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:34.578224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:34.634984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e3a50-a110-42b6-b94e-84b211051d3c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:34.639133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:34.639739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:34.640022 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:34.640290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:34.650262 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:34.651745 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:34.661910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1379/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:58:34.933642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:34.935224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:34.948155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50a7a-e8ec-43e0-899d-f1070a42aa12 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:34.952872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:34.953504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:34.953776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:34.954036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] PATH_INFO: `/v3/projects/69db0f36e3b24d4d98976c2c5f633cd9` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:34.955218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69db0f36e3b24d4d98976c2c5f633cd9)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:34.957269 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:35.005902 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69db0f36e3b24d4d98976c2c5f633cd9', 'request_id': 'req-505a6961-1603-42d3-9ed6-e905a615ac8d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.011452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69db0f36e3b24d4d98976c2c5f633cd9', 'request_id': 'req-505a6961-1603-42d3-9ed6-e905a615ac8d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.017649 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69db0f36e3b24d4d98976c2c5f633cd9', 'request_id': 'req-505a6961-1603-42d3-9ed6-e905a615ac8d'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.032435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] The token cache is being invalidate because project 69db0f36e3b24d4d98976c2c5f633cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:35.032721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.033344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.034881 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1374/2753] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:34 2022] DELETE /identity/v3/projects/69db0f36e3b24d4d98976c2c5f633cd9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:35.039156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:35.049032 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8844f-a924-4835-bae9-f8c8abc30437 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:35.117355 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:35.118205 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:35.118547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:35.118847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] PATH_INFO: `/v3/users/15e23a0f4e4d4c8a8f104d7a09b6453a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:35.120655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e23a0f4e4d4c8a8f104d7a09b6453a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:35.123741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:35.174784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:35.179330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e23a0f4e4d4c8a8f104d7a09b6453a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.180352 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e23a0f4e4d4c8a8f104d7a09b6453a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.191476 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e23a0f4e4d4c8a8f104d7a09b6453a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.204863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e23a0f4e4d4c8a8f104d7a09b6453a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.205564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e23a0f4e4d4c8a8f104d7a09b6453a'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.220771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1380/2754] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:35 2022] DELETE /identity/v3/users/15e23a0f4e4d4c8a8f104d7a09b6453a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:35.620600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:35.622471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:35.636161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a6961-1603-42d3-9ed6-e905a615ac8d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:35.684732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:35.732284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:35.733092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:35.733369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:35.733676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] PATH_INFO: `/v3/projects/d58fd7536efb45a39bbdeca619453a58` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:35.735393 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58fd7536efb45a39bbdeca619453a58)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:35.742013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:35.795581 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58fd7536efb45a39bbdeca619453a58', 'request_id': 'req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.802011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58fd7536efb45a39bbdeca619453a58', 'request_id': 'req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.808470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58fd7536efb45a39bbdeca619453a58', 'request_id': 'req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.823035 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] The token cache is being invalidate because project d58fd7536efb45a39bbdeca619453a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:35.823325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.823964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.825446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1375/2755] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:35 2022] DELETE /identity/v3/projects/d58fd7536efb45a39bbdeca619453a58 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:35.830381 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:35.831986 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:35.845660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d620e-fadd-425b-bb3e-392e98b4aa55 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:35.903668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:35.904412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:35.904686 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:35.904968 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] PATH_INFO: `/v3/users/bdb02378b48e46379925041a04adb4aa` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:35.906144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb02378b48e46379925041a04adb4aa)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:35.908108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:35.956665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb02378b48e46379925041a04adb4aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.957302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb02378b48e46379925041a04adb4aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.965273 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb02378b48e46379925041a04adb4aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.978160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb02378b48e46379925041a04adb4aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.978961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-e77b3afa-4370-4887-911c-bd93defcab8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb02378b48e46379925041a04adb4aa'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:35.995833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1381/2756] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:35 2022] DELETE /identity/v3/users/bdb02378b48e46379925041a04adb4aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:36.290887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.292457 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:36.315216 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bc7d-eb1e-41a9-9b78-a0bf51898dfb admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.386567 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.387510 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.387842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.388371 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] PATH_INFO: `/v3/projects/5f8a3241d54f4d73874fededc4e6ef91` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.389540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8a3241d54f4d73874fededc4e6ef91)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.391593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.449392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8a3241d54f4d73874fededc4e6ef91', 'request_id': 'req-c37013f8-c282-4826-8ae3-8523187eb4d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:36.457385 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8a3241d54f4d73874fededc4e6ef91', 'request_id': 'req-c37013f8-c282-4826-8ae3-8523187eb4d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:36.461064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:36.467978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8a3241d54f4d73874fededc4e6ef91', 'request_id': 'req-c37013f8-c282-4826-8ae3-8523187eb4d4'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:36.489332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] The token cache is being invalidate because project 5f8a3241d54f4d73874fededc4e6ef91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:36.489659 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:36.490720 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c37013f8-c282-4826-8ae3-8523187eb4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:36.492509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1376/2757] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:36 2022] DELETE /identity/v3/projects/5f8a3241d54f4d73874fededc4e6ef91 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:36.497457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.497741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.498062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.530241 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:36.531759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:36.572107 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:36.601783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1382/2758] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:36.610283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.610475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.610773 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.632879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:36.634185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:36.642401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1377/2759] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:36.646841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.656622 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4d08-17c0-4c0b-8429-c77992d09b23 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.661643 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.662250 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.662587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.662895 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.663573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:58:36.663872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.665510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.680955 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1383/2760] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:58:36.682007 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.691329 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658eb60e-5dc6-4651-8183-634abafc52ee None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.696252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.696874 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.697149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.697448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.698084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.700031 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.736463 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1378/2761] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:36 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:58:36.747100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.758245 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2877-1467-4da5-b4ca-d9f3d95e5ecf admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.829021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.830415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.830415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.831131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.831349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.833270 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.865434 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1384/2762] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:36 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:36.869432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.881439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5aef-1f2f-4402-bb00-2ee84d7ce7e3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.887351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.888293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.888685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.889051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.889809 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.892532 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.903853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1379/2763] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:58:36.907824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.919928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c69b4-919a-4f41-8a0d-c4845819fccb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.925295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04296f-9e9d-4012-b477-2ba0addc8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.925928 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04296f-9e9d-4012-b477-2ba0addc8b66 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.926197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04296f-9e9d-4012-b477-2ba0addc8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.926465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04296f-9e9d-4012-b477-2ba0addc8b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.927421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04296f-9e9d-4012-b477-2ba0addc8b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.929224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04296f-9e9d-4012-b477-2ba0addc8b66 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.944840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1385/2764] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:58:36.946118 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:36.956490 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d998-f8a1-4e99-a571-5ff5cbc8df45 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:36.961868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:36.963016 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:36.963412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:36.963761 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] PATH_INFO: `/v3/projects/5442c9f5d7ae493da66b73958e1ce03e/users/59328df138c54dc29abf70d5b41010a0/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:36.980498 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5442c9f5d7ae493da66b73958e1ce03e, user_id=59328df138c54dc29abf70d5b41010a0, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:36.983336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:36.999563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1380/2765] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:36 2022] PUT /identity/v3/projects/5442c9f5d7ae493da66b73958e1ce03e/users/59328df138c54dc29abf70d5b41010a0/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:37.070951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948090-5a11-4feb-83ae-1a45c1c1efe5 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:37.071289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948090-5a11-4feb-83ae-1a45c1c1efe5 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:37.071559 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948090-5a11-4feb-83ae-1a45c1c1efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:37.101521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-52948090-5a11-4feb-83ae-1a45c1c1efe5 None None] MFA Rules not processed for user `59328df138c54dc29abf70d5b41010a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:37.102797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-52948090-5a11-4feb-83ae-1a45c1c1efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:37.171973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1386/2766] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:37.183717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:37.185591 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:37.247500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d2f6-f5f6-4e87-8251-a896b4867cfc admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:37.251721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:37.252336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:37.252608 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:37.252873 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:37.262155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:37.263628 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:37.273098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1381/2767] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:39.937638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:39.938164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:39.938297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:39.958625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] MFA Rules not processed for user `fb794bb0f8984d218197d81eded1e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:39.960028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:39.991028 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:40.019111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1387/2768] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:40.928866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:40.930367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:40.996302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d95a76-caca-45e4-a4e1-1525cc816f25 service glance] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:41.000319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:41.000935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:41.001212 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:41.001652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:41.004043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:41.049823 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:41.079217 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:41.080869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222754ee-74cb-4b38-b60a-f5ef721cc8bc service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:41.093219 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1382/2769] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:50.009826 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=9 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:51.088101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=14 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:04.594901 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:04.659679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7bd23-8f0a-42fa-9cce-966c366a2666 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:04.665233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:04.665877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:04.666150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:04.666424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] PATH_INFO: `/v3/users/59328df138c54dc29abf70d5b41010a0` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:04.667702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] RBAC: Authorizing `identity:delete_user(user_id=59328df138c54dc29abf70d5b41010a0)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:04.669624 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:04.720635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59328df138c54dc29abf70d5b41010a0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:04.721382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59328df138c54dc29abf70d5b41010a0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:04.728951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59328df138c54dc29abf70d5b41010a0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:04.743055 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59328df138c54dc29abf70d5b41010a0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:04.743854 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59328df138c54dc29abf70d5b41010a0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:04.758276 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1388/2770] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 11:59:04 2022] DELETE /identity/v3/users/59328df138c54dc29abf70d5b41010a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:04.762956 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:04.763488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:04.763488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:04.782920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:04.784110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:04.846086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1383/2771] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:04.856026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:04.857607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:04.920240 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20bee-b681-4395-b268-37ced258847c admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:04.924268 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d83e22-3e57-4c3f-93d4-abb5e684984a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:04.924874 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83e22-3e57-4c3f-93d4-abb5e684984a service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:04.925151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83e22-3e57-4c3f-93d4-abb5e684984a service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:04.925420 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83e22-3e57-4c3f-93d4-abb5e684984a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:04.935646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d83e22-3e57-4c3f-93d4-abb5e684984a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:04.937085 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d83e22-3e57-4c3f-93d4-abb5e684984a service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:04.946947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1389/2772] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:05.246163 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.247811 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:05.260011 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c06b-8ff3-4917-aedd-9306d71b4a87 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.265369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.265981 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.266256 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.266521 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] PATH_INFO: `/v3/projects/5442c9f5d7ae493da66b73958e1ce03e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.267887 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5442c9f5d7ae493da66b73958e1ce03e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.269688 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.320488 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5442c9f5d7ae493da66b73958e1ce03e', 'request_id': 'req-a59fd827-f228-4720-8f91-821b9f0e2bff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:05.326281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5442c9f5d7ae493da66b73958e1ce03e', 'request_id': 'req-a59fd827-f228-4720-8f91-821b9f0e2bff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:05.332921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5442c9f5d7ae493da66b73958e1ce03e', 'request_id': 'req-a59fd827-f228-4720-8f91-821b9f0e2bff'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:05.347491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] The token cache is being invalidate because project 5442c9f5d7ae493da66b73958e1ce03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:59:05.347789 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:05.348496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a59fd827-f228-4720-8f91-821b9f0e2bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:05.349959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1384/2773] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 11:59:05 2022] DELETE /identity/v3/projects/5442c9f5d7ae493da66b73958e1ce03e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:05.355152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.355438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.355707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.376202 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:05.377410 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:05.395810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:05.440872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1390/2774] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:59:05.448920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.449231 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.449507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.470484 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:05.471741 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:05.480342 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1385/2775] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:05.484561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.494394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c4f2-2a7b-4634-aa8a-946c434a76ff None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.499991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.500829 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.501108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.501378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.502034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:59:05.502340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.504035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.516606 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1391/2776] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 11:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:59:05.521148 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.530714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3d37b-6c91-4925-a987-e0fe9b596e83 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.536827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.537424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.537699 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.537962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.538590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.540539 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.573115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1386/2777] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:59:05 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:59:05.578848 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.589493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e3f75-44d9-4b7f-a8be-771bcb183055 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.651566 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.652324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.652433 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.652705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.653389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.655366 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.683720 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1392/2778] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:59:05 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:59:05.688502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.700625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189bc2-13e9-41c0-8344-cac578868a93 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.705994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.706592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.706990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.707264 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.707908 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.709588 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.720401 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1387/2779] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:05.724571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.734948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28321e12-6e46-4f25-a2cf-8d1c50b1efb7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.740461 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a388431-119f-4978-bc5e-ecf92381e72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.741075 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388431-119f-4978-bc5e-ecf92381e72d admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.741335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388431-119f-4978-bc5e-ecf92381e72d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.741599 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388431-119f-4978-bc5e-ecf92381e72d admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.742304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a388431-119f-4978-bc5e-ecf92381e72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.744293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a388431-119f-4978-bc5e-ecf92381e72d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.754939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1393/2780] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:05.759367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.769653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc5ef-9f17-4890-95b2-22bd08606fb3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.774594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.775318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.775627 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.775892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] PATH_INFO: `/v3/projects/e4a8677ec9c34caba7bcda7ccba3625e/users/5624b84c8e2947f3902035827e42884b/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.791207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a8677ec9c34caba7bcda7ccba3625e, user_id=5624b84c8e2947f3902035827e42884b, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.793925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.808346 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1388/2781] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:59:05 2022] PUT /identity/v3/projects/e4a8677ec9c34caba7bcda7ccba3625e/users/5624b84c8e2947f3902035827e42884b/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:05.813579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8788574-ed96-4389-a8bf-7a6566d1b5e3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.813861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8788574-ed96-4389-a8bf-7a6566d1b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.814131 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8788574-ed96-4389-a8bf-7a6566d1b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.833681 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-e8788574-ed96-4389-a8bf-7a6566d1b5e3 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:05.834930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e8788574-ed96-4389-a8bf-7a6566d1b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:05.899692 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1394/2782] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:05.909690 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:05.911619 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:05.933899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:05.970559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6a454-7651-4146-84a6-647486847561 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:05.975180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:05.975786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:05.976041 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:05.976303 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:05.986362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:05.987835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:05.997680 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1389/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:09.632378 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.632865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.632977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.664872 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] MFA Rules not processed for user `5624b84c8e2947f3902035827e42884b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:09.666100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:09.684770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:09.742498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1395/2784] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:09.746890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.759298 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437846d7-0881-4a70-b7ea-b28bf3bd9464 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.764408 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.765017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.765295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.765563 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.766193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.768145 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.798998 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1390/2785] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 11:59:09 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:59:09.803318 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.819794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba712c-595c-4c01-b658-27c914a4fad4 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.908349 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.909267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.909544 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.909820 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.910526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.912499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.937756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1396/2786] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 11:59:09 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:59:09.942086 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.952990 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08c3e-0d89-4eab-bfa6-89c82ca047ef admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.958279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.959085 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.959417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.959749 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.963449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.970159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.982550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1391/2787] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:09.987161 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.998235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f97c-1c80-437e-a6c4-524acc5b924b admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:10.002953 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:10.003621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:10.003961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:10.004278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] PATH_INFO: `/v3/projects/ff714768b273400e859ce9722940d858/users/bb169ebff036441e9eb1831409cdf7c8/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:10.020432 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff714768b273400e859ce9722940d858, user_id=bb169ebff036441e9eb1831409cdf7c8, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:10.023252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:10.037878 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1397/2788] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:59:09 2022] PUT /identity/v3/projects/ff714768b273400e859ce9722940d858/users/bb169ebff036441e9eb1831409cdf7c8/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:10.042162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:10.052568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f323b-ec21-4729-aaa6-7d33502201bc admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:10.111258 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e22448-a6fc-435f-8adb-14bab5bce233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:10.111917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e22448-a6fc-435f-8adb-14bab5bce233 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:10.112192 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e22448-a6fc-435f-8adb-14bab5bce233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:10.112461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e22448-a6fc-435f-8adb-14bab5bce233 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:10.113107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e22448-a6fc-435f-8adb-14bab5bce233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:10.114779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e22448-a6fc-435f-8adb-14bab5bce233 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:10.125157 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1392/2789] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:10.129479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:10.140323 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb357b-7b1c-4576-a73e-cacf9ebf7cdb admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:10.144983 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:10.145645 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:10.145920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:10.146193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] PATH_INFO: `/v3/projects/ff714768b273400e859ce9722940d858/users/bb169ebff036441e9eb1831409cdf7c8/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:10.148186 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff714768b273400e859ce9722940d858, user_id=bb169ebff036441e9eb1831409cdf7c8, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:10.150918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:10.161961 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1398/2790] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 11:59:10 2022] PUT /identity/v3/projects/ff714768b273400e859ce9722940d858/users/bb169ebff036441e9eb1831409cdf7c8/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:14.355090 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92fa0a-eb49-44ad-990c-13bd33428ade None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:14.355911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92fa0a-eb49-44ad-990c-13bd33428ade None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:14.356182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92fa0a-eb49-44ad-990c-13bd33428ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:14.386104 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3e92fa0a-eb49-44ad-990c-13bd33428ade None None] MFA Rules not processed for user `bb169ebff036441e9eb1831409cdf7c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:14.387392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3e92fa0a-eb49-44ad-990c-13bd33428ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:14.455975 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1393/2791] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:14.468035 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:14.470008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:14.538110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b19e5-4305-46fc-977c-c7c9ba79b341 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:14.546192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aaccbf6e1e746f5b7285d57564d9d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:14.546869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:14.547154 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:14.547425 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:14.578876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:14.622148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:14.623656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:14.633610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1399/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:14.815652 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:14.815937 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:14.816322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:14.837480 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:14.876623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:14.877917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:14.947574 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1394/2793] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:14.996702 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:14.998272 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:15.094752 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57a40-9845-4a42-88db-55e1cab5bd4f service glance] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:15.099892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50685-bf08-44bf-bab2-ab59e3fb1794 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:15.100500 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50685-bf08-44bf-bab2-ab59e3fb1794 service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:15.100775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50685-bf08-44bf-bab2-ab59e3fb1794 service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:15.101044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50685-bf08-44bf-bab2-ab59e3fb1794 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:15.110038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a50685-bf08-44bf-bab2-ab59e3fb1794 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:15.111659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a50685-bf08-44bf-bab2-ab59e3fb1794 service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:15.119717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1400/2794] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:59:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:59:21.631664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:21.633315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:21.700739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad1f7-9c2f-485f-a1b4-33a2883aeeaf None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:21.705230 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:21.705871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:21.706245 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:21.706743 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:21.716820 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:21.730555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:21.732173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:21.742599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1395/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:23.488518 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:23.489040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:23.489040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:23.510223 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] MFA Rules not processed for user `5624b84c8e2947f3902035827e42884b`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:23.511529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:23.519656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1401/2796] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 11:59:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:24.024653 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:24.037927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea38f7-0846-48a7-b8c1-5dac128b675e service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:24.044951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:24.045716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:24.046032 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:24.046400 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:24.049592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:24.060411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:24.061853 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4190a2-af4a-4e66-b583-41efffb4cbb4 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:24.070008 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1396/2797] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:24.413264 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:24.414809 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:24.489109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2282-5e43-41ae-9a29-8025cf6f74c3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:24.494707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:24.495345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:24.495605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:24.495877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:24.497837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:24.509572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:24.511188 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:24.521236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1402/2798] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:25.871136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:25.871654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:25.871654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:25.892344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:25.893630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:25.901728 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1397/2799] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 6 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:25.914108 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:25.926034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7f1c-29b7-41c9-b52e-c7c40c52c4e8 service placement] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:25.932669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:25.933185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:25.933480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:25.933727 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:25.943342 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:25.945590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:25.955608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1403/2800] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 11:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:59:35.887097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=70 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:35.951973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=98 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:40.327249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:40.328876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:40.412968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7952-3888-42a3-9b9d-cc8546a48bc9 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:40.418962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:40.419587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:40.419866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:40.420160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:40.421927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:40.434655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:40.436283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:40.447092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1398/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:46.053288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:46.066522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2b73-bfa5-46a4-933e-2e30956a0f17 service swift] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:46.072127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:46.072760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:46.073037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:46.073306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:46.075057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:46.087619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:46.089213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:46.102076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1404/2802] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:50.442435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=34 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:53.163432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:53.173736 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ef1b7-fd3b-44bf-bc71-f1323aa3f70f service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:53.178314 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:53.178968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:53.179247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:53.179515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:53.188836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:53.190275 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:53.199740 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1399/2803] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:54.838522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:54.851173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ceb48-8b23-45ad-9634-6b6d104aeca7 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:54.858735 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:54.859234 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:54.859512 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:54.859780 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:54.861569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:54.874638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:54.876267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:54.898845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1405/2804] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:03.195846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=6 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:04.883691 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=12 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:07.906398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:07.921620 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961bd4c-46ff-4863-ba50-5df35c69ecf2 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:07.927473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:07.928072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:07.928343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:07.928642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:07.930466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:08.007552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:08.009645 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:08.020194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1400/2805] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:18.015552 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=28 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:28.598556 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:28.609122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a1aa-29a6-4821-8a14-de68001afce5 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:28.612863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:28.613481 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:28.613746 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:28.614014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:28.615797 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:28.680621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:28.682062 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:28.692712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1406/2806] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 12:00:31.580182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:31.582013 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:31.601991 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe92044-84ee-4d57-b2c1-16b5c56e3b76 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:31.607137 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:31.609429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:31.612935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:31.613797 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:31.614229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:31.615623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:31.618343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:31.625803 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d964e06-6a08-47be-b385-b30b6607e3e2 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:31.631558 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:31.632191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:31.632639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:31.633077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] PATH_INFO: `/v3/users/fb794bb0f8984d218197d81eded1e5cf` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:31.634214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb794bb0f8984d218197d81eded1e5cf)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:31.634623 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:31.636392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:31.636528 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:31.647861 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1401/2807] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:00:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:31.705278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb794bb0f8984d218197d81eded1e5cf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:31.706279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb794bb0f8984d218197d81eded1e5cf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:31.713149 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb794bb0f8984d218197d81eded1e5cf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:31.726438 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb794bb0f8984d218197d81eded1e5cf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:31.727143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2b873a3f-3daa-4c9e-aeb3-fc13588db599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb794bb0f8984d218197d81eded1e5cf'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:31.741387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1407/2808] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:00:31 2022] DELETE /identity/v3/users/fb794bb0f8984d218197d81eded1e5cf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:00:31.926318 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:31.937618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3ea7b-879d-40cb-884c-ba389f32a8db service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:31.995122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:31.995760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:31.996038 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:31.996307 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] PATH_INFO: `/v3/projects/219852ae38654e9192e7cf61784825c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:31.997482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219852ae38654e9192e7cf61784825c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:31.999508 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.047422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219852ae38654e9192e7cf61784825c2', 'request_id': 'req-8ee1d035-710f-4b22-833f-e04637de9173'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:32.053174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219852ae38654e9192e7cf61784825c2', 'request_id': 'req-8ee1d035-710f-4b22-833f-e04637de9173'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:32.059301 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219852ae38654e9192e7cf61784825c2', 'request_id': 'req-8ee1d035-710f-4b22-833f-e04637de9173'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:32.073282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] The token cache is being invalidate because project 219852ae38654e9192e7cf61784825c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:00:32.073566 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:32.074182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8ee1d035-710f-4b22-833f-e04637de9173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:00:32.075676 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1402/2809] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:00:31 2022] DELETE /identity/v3/projects/219852ae38654e9192e7cf61784825c2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:00:32.080753 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.081398 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.081668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.102935 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:00:32.104090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:32.165112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1408/2810] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:00:32.172950 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.173237 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.173515 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.194037 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:00:32.195315 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:32.204509 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1403/2811] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:00:32.209003 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.226370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bc6dd-e4aa-47e0-920a-00412b2618c7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.231510 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.232159 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.232447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.232704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.233361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:00:32.233668 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.235395 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.237106 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:32.255644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1409/2812] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 12:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:00:32.256812 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.266390 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fec19-a80c-498f-8396-e73d66b44807 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.271194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.271842 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.272125 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.272391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.273023 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.274963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.302599 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1404/2813] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 12:00:32.306999 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.317333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482572-bc9d-4aae-ae5a-177eb1400151 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.386079 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.386612 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.386918 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.387187 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.387836 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.389866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.412232 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1410/2814] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:00:32.416525 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.427546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709664-fd47-46f7-9aea-16514ea3df38 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.432384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.432979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.433257 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.433526 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.434172 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.435813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.445846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1405/2815] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 12:00:32.450007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.460642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8570a8-2aae-43c6-8b67-14686a13aa05 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.465705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5d668-b16f-48cb-9be8-276a8ae898f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.466305 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d668-b16f-48cb-9be8-276a8ae898f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.466577 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d668-b16f-48cb-9be8-276a8ae898f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.466877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d668-b16f-48cb-9be8-276a8ae898f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.467516 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5d668-b16f-48cb-9be8-276a8ae898f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.469227 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5d668-b16f-48cb-9be8-276a8ae898f3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.480040 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1411/2816] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 12:00:32.484331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.495833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec515ee-179f-466e-bfbc-7edb04a88f0d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.502056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.502713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.503019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.503281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] PATH_INFO: `/v3/projects/bb2f6f96f5a740f1a6ff811bedbf3e22/users/01a5252505a2498f9ff5c804cedafcd0/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.518523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2f6f96f5a740f1a6ff811bedbf3e22, user_id=01a5252505a2498f9ff5c804cedafcd0, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.521200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.534993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1406/2817] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:00:32 2022] PUT /identity/v3/projects/bb2f6f96f5a740f1a6ff811bedbf3e22/users/01a5252505a2498f9ff5c804cedafcd0/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:00:32.547171 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.547468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.547773 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.576610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] MFA Rules not processed for user `01a5252505a2498f9ff5c804cedafcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:00:32.577824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:32.645607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1412/2818] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:00:32.650136 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.663702 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:32.715706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efd17-aa7f-462d-98f8-4ae922f3a80b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.720471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.721076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.721351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.721613 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.722235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.724169 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.753095 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1407/2819] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:00:32.757428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.768521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e313-f7c7-4667-a520-8faaf706ffe3 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.830672 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.831675 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.831954 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.832225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.832838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.834801 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.843830 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:32.858282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1413/2820] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:00:32 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:00:32.862331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.872868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb0748-c355-4a36-8c8d-2be24147e61f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.878015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.878612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.878917 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.879181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.879829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.881424 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.892473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1408/2821] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:00:32.898542 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.909322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9025a8-f2dd-47f9-82e7-d5dd0718e3bc admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:32.915007 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:32.915647 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:32.915920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:32.916178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] PATH_INFO: `/v3/projects/b493dd1257ac45818b7ec1dc3317eda9/users/ac7abbbde24d4fbb9b1cbe3dd0d9e4d7/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:32.931683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b493dd1257ac45818b7ec1dc3317eda9, user_id=ac7abbbde24d4fbb9b1cbe3dd0d9e4d7, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:32.934418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:32.948659 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1414/2822] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:00:32 2022] PUT /identity/v3/projects/b493dd1257ac45818b7ec1dc3317eda9/users/ac7abbbde24d4fbb9b1cbe3dd0d9e4d7/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:00:32.952675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:32.963357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57e199-6d9b-4d07-a6dd-a2d57af34637 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:33.022493 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ad32-1d80-4f8e-a516-e3ad3e52c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:33.023126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ad32-1d80-4f8e-a516-e3ad3e52c59a admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:33.023402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ad32-1d80-4f8e-a516-e3ad3e52c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:33.023666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ad32-1d80-4f8e-a516-e3ad3e52c59a admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:33.024293 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ad32-1d80-4f8e-a516-e3ad3e52c59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:33.025916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ad32-1d80-4f8e-a516-e3ad3e52c59a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:33.035590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1409/2823] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:00:33.040111 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:33.050827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276c81-950d-4420-9b85-5cf98df291a3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:33.056122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:33.056755 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:33.057033 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:33.057304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] PATH_INFO: `/v3/projects/b493dd1257ac45818b7ec1dc3317eda9/users/ac7abbbde24d4fbb9b1cbe3dd0d9e4d7/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:33.059357 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b493dd1257ac45818b7ec1dc3317eda9, user_id=ac7abbbde24d4fbb9b1cbe3dd0d9e4d7, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:33.062011 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:33.072563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1415/2824] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:00:33 2022] PUT /identity/v3/projects/b493dd1257ac45818b7ec1dc3317eda9/users/ac7abbbde24d4fbb9b1cbe3dd0d9e4d7/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:00:33.083366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:33.083629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:33.083921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:33.122829 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] MFA Rules not processed for user `ac7abbbde24d4fbb9b1cbe3dd0d9e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:00:33.124073 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:33.202147 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1410/2825] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:00:33.214505 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:33.216403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:33.278031 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a08e49-9584-4a86-a92c-5287cefc5278 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:33.283744 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:33.284615 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:33.284939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:33.285300 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:33.299717 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:33.301172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:33.311233 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1416/2826] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:00:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:33.396746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:33.407278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33ae83-e62d-420e-9ce9-f8492eab56d1 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:33.411261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07f632-7951-4ce7-be3e-a478f10506a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:33.411927 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07f632-7951-4ce7-be3e-a478f10506a1 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:33.412202 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07f632-7951-4ce7-be3e-a478f10506a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:33.412473 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07f632-7951-4ce7-be3e-a478f10506a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:33.418160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:33.479760 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07f632-7951-4ce7-be3e-a478f10506a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:33.481116 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07f632-7951-4ce7-be3e-a478f10506a1 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:33.490637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1411/2827] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:00:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:43.306529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:43.486715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=24 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:03.211215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:03.275403 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dff1-4dad-46b4-9232-e6f22ebed767 service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:03.281156 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:03.281786 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:03.282059 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:03.282324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] PATH_INFO: `/v3/users/01a5252505a2498f9ff5c804cedafcd0` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:03.283677 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a5252505a2498f9ff5c804cedafcd0)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:03.285621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:03.334267 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a5252505a2498f9ff5c804cedafcd0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.334980 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a5252505a2498f9ff5c804cedafcd0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.342394 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a5252505a2498f9ff5c804cedafcd0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.356143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a5252505a2498f9ff5c804cedafcd0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.356894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a5252505a2498f9ff5c804cedafcd0'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.370533 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1417/2828] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:03 2022] DELETE /identity/v3/users/01a5252505a2498f9ff5c804cedafcd0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 12:01:03.375238 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:03.375777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:03.375777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:03.394906 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:03.396178 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:03.456724 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1412/2829] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:03.466317 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:03.468039 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:03.525392 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995511b-a62b-4d45-b963-0533a4179522 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:03.529514 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:03.530073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:03.530326 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:03.530595 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:03.540105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:03.541571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:03.551249 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1418/2830] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:03.827162 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:03.828964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:03.844732 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53803-97f0-45c7-84f3-987c990fc627 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:03.850328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:03.851040 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:03.851310 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:03.851553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] PATH_INFO: `/v3/projects/bb2f6f96f5a740f1a6ff811bedbf3e22` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:03.852909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2f6f96f5a740f1a6ff811bedbf3e22)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:03.854872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:03.907222 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2f6f96f5a740f1a6ff811bedbf3e22', 'request_id': 'req-3742bfde-711c-411d-9fbf-cea904e648cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.913911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2f6f96f5a740f1a6ff811bedbf3e22', 'request_id': 'req-3742bfde-711c-411d-9fbf-cea904e648cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.920602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2f6f96f5a740f1a6ff811bedbf3e22', 'request_id': 'req-3742bfde-711c-411d-9fbf-cea904e648cf'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.935461 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] The token cache is being invalidate because project bb2f6f96f5a740f1a6ff811bedbf3e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:03.935747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.936359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:03.937871 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1413/2831] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:03 2022] DELETE /identity/v3/projects/bb2f6f96f5a740f1a6ff811bedbf3e22 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:03.942252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:03.957287 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c182b-b2a0-4ff9-b203-64a256633a3f service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:03.977110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:04.017838 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.018468 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.018790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.019037 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] PATH_INFO: `/v3/users/ac7abbbde24d4fbb9b1cbe3dd0d9e4d7` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.020278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7abbbde24d4fbb9b1cbe3dd0d9e4d7)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.022214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.070351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7abbbde24d4fbb9b1cbe3dd0d9e4d7'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.070973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7abbbde24d4fbb9b1cbe3dd0d9e4d7'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.078090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7abbbde24d4fbb9b1cbe3dd0d9e4d7'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.090499 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7abbbde24d4fbb9b1cbe3dd0d9e4d7'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.091201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-93fd670a-454e-4f80-a5bc-147f34a0385d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7abbbde24d4fbb9b1cbe3dd0d9e4d7'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.105177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1419/2832] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:03 2022] DELETE /identity/v3/users/ac7abbbde24d4fbb9b1cbe3dd0d9e4d7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:04.394074 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.395601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:04.412970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bfde-711c-411d-9fbf-cea904e648cf admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:04.474196 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.474863 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.475131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.475402 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] PATH_INFO: `/v3/projects/b493dd1257ac45818b7ec1dc3317eda9` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.476553 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b493dd1257ac45818b7ec1dc3317eda9)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.478540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.515779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:04.534336 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b493dd1257ac45818b7ec1dc3317eda9', 'request_id': 'req-b5319477-d517-4478-bb8c-e1acf0ffa9fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.540226 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b493dd1257ac45818b7ec1dc3317eda9', 'request_id': 'req-b5319477-d517-4478-bb8c-e1acf0ffa9fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.546876 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b493dd1257ac45818b7ec1dc3317eda9', 'request_id': 'req-b5319477-d517-4478-bb8c-e1acf0ffa9fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.561100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] The token cache is being invalidate because project b493dd1257ac45818b7ec1dc3317eda9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:04.561387 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.562019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-b5319477-d517-4478-bb8c-e1acf0ffa9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:04.563540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1414/2833] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:04 2022] DELETE /identity/v3/projects/b493dd1257ac45818b7ec1dc3317eda9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:04.568562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.569090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.569090 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.589391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:04.590594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:04.653549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1420/2834] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 12:01:04.661593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.661879 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.662149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.682780 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:04.683910 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:04.706174 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1415/2835] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:04.710589 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.721756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be45c51-0e36-47c2-9054-c278bc18057d None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:04.726863 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.727593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.727904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.728177 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] PATH_INFO: `/v3/domains` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.728831 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:01:04.729130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.730743 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.747058 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1421/2836] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 12:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:01:04.751669 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.763866 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c85b3-f5ac-4061-bf87-eac2982a275a None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:04.769818 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.770422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.770714 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.771006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.771646 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.773568 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.809828 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1416/2837] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:04.814653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.827547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c68c-e6bc-4425-b3fe-7b04ced1c992 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:04.854784 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:04.886236 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.886906 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.887178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.887448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.888065 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.889978 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.912335 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1422/2838] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:04 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:04.916602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.927177 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72efef-1ffe-41fa-9a6e-729a7fc906c9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:04.932717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.933312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.933592 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.933848 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.934486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.936126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.946507 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1417/2839] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:04.950759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.961453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3080cf-e291-4020-a235-c666535b0757 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:04.967310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7978c2b-ea96-4327-87cc-b78207dbcdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:04.967909 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7978c2b-ea96-4327-87cc-b78207dbcdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:04.968184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7978c2b-ea96-4327-87cc-b78207dbcdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:04.968452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7978c2b-ea96-4327-87cc-b78207dbcdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:04.969099 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7978c2b-ea96-4327-87cc-b78207dbcdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:04.970729 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7978c2b-ea96-4327-87cc-b78207dbcdd5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:04.981135 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1423/2840] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:04.985241 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:04.995392 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682e588-485f-4fea-ab61-e461d93f793a admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.000360 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.001001 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.001277 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.001544 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] PATH_INFO: `/v3/projects/bcc3c564aa2e4f5495de78c2e67db4a3/users/27ce0b8f8e2b4eeba175916f648f5813/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.018618 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc3c564aa2e4f5495de78c2e67db4a3, user_id=27ce0b8f8e2b4eeba175916f648f5813, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.021260 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.037418 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1418/2841] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:04 2022] PUT /identity/v3/projects/bcc3c564aa2e4f5495de78c2e67db4a3/users/27ce0b8f8e2b4eeba175916f648f5813/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:05.048197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.048469 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.048747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.078191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] MFA Rules not processed for user `27ce0b8f8e2b4eeba175916f648f5813`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:05.079794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:05.151534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1424/2842] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 12:01:05.156311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.222709 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3079f-0b45-4ac7-aa0d-7e90ccd0966e admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.227888 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.228500 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.228779 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.229057 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] PATH_INFO: `/v3/projects` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.229684 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.231677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.260388 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1419/2843] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:05 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:05.264881 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.276393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71e4e-9076-4e92-a4fa-e9f91e6350fe None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.336448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.337051 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.337320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.337585 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.338200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.340160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.363787 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1425/2844] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:05 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 12:01:05.368284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.379139 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba9c87-ea4f-4474-8cc8-5d0665a0e00f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.384689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.385327 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.385605 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.385872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.386518 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.388355 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.399530 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1420/2845] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 12:01:05.403688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.414184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1bd2-adaf-4cf2-ba22-ba6a144b07b8 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.419768 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.420413 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.420685 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.420960 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] PATH_INFO: `/v3/projects/2cec767aee72445199ef6907f24af3ec/users/fb371c8bd92b40fe89ef4126d2226b77/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.435835 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cec767aee72445199ef6907f24af3ec, user_id=fb371c8bd92b40fe89ef4126d2226b77, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.438498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.454123 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1426/2846] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:05 2022] PUT /identity/v3/projects/2cec767aee72445199ef6907f24af3ec/users/fb371c8bd92b40fe89ef4126d2226b77/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:05.459514 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.469602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d78f6-3aef-4f76-bc15-9284cfc8a6e9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.489630 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:05.528411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ef528-f968-4975-b382-9bfc78860164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.528946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef528-f968-4975-b382-9bfc78860164 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.529223 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef528-f968-4975-b382-9bfc78860164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.529491 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef528-f968-4975-b382-9bfc78860164 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.530127 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ef528-f968-4975-b382-9bfc78860164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.531775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ef528-f968-4975-b382-9bfc78860164 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.541409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1421/2847] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:05.545808 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.551695 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:05.557372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49606-1ee7-4c95-bccb-291cdaced479 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.563337 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.563984 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.564256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.564521 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] PATH_INFO: `/v3/projects/2cec767aee72445199ef6907f24af3ec/users/fb371c8bd92b40fe89ef4126d2226b77/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.566600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cec767aee72445199ef6907f24af3ec, user_id=fb371c8bd92b40fe89ef4126d2226b77, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.569299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.580580 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1427/2848] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:05 2022] PUT /identity/v3/projects/2cec767aee72445199ef6907f24af3ec/users/fb371c8bd92b40fe89ef4126d2226b77/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:05.591713 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.591999 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.592272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.623229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] MFA Rules not processed for user `fb371c8bd92b40fe89ef4126d2226b77`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:05.624432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:05.695914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1422/2849] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:05.707541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.709716 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:05.776749 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f2bc-4fb8-4218-945b-9dbd33b963f7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.780552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd294b-c79d-4738-94fa-4f45de14caae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.781172 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd294b-c79d-4738-94fa-4f45de14caae service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.781448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd294b-c79d-4738-94fa-4f45de14caae service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.781718 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd294b-c79d-4738-94fa-4f45de14caae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.791571 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd294b-c79d-4738-94fa-4f45de14caae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.793020 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd294b-c79d-4738-94fa-4f45de14caae service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.804113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1428/2850] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:05.833610 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:05.896242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8f0eb-8776-45f1-b2c7-554370a3f3d0 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:05.900890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:05.901517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:05.901787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:05.902054 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] PATH_INFO: `/v3/users/27ce0b8f8e2b4eeba175916f648f5813` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:05.903205 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ce0b8f8e2b4eeba175916f648f5813)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:05.905110 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:05.958911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ce0b8f8e2b4eeba175916f648f5813'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:05.959693 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ce0b8f8e2b4eeba175916f648f5813'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:05.961281 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:05.969020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ce0b8f8e2b4eeba175916f648f5813'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:05.981324 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ce0b8f8e2b4eeba175916f648f5813'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:05.981967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ce0b8f8e2b4eeba175916f648f5813'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:05.996559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1423/2851] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:05 2022] DELETE /identity/v3/users/27ce0b8f8e2b4eeba175916f648f5813 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:06.001145 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:06.001439 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:06.001711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:06.020992 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:06.022197 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:06.103609 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1429/2852] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:06.113654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:06.115203 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:06.177285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b505a7e-3367-4dab-9c81-ef94ebb84518 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:06.181734 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:06.182332 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:06.182609 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:06.182909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:06.192381 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:06.193835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:06.203651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1424/2853] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:06.501632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:06.503179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:06.518943 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750adc-2a0f-4e4e-9d60-6c4f55efb4a9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:06.523912 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:06.524705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:06.524982 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:06.525246 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] PATH_INFO: `/v3/projects/bcc3c564aa2e4f5495de78c2e67db4a3` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:06.526600 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc3c564aa2e4f5495de78c2e67db4a3)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:06.528564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:06.577044 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc3c564aa2e4f5495de78c2e67db4a3', 'request_id': 'req-30a6d773-cd73-4a32-a3ab-fd1312a5c849'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.582937 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc3c564aa2e4f5495de78c2e67db4a3', 'request_id': 'req-30a6d773-cd73-4a32-a3ab-fd1312a5c849'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.590957 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc3c564aa2e4f5495de78c2e67db4a3', 'request_id': 'req-30a6d773-cd73-4a32-a3ab-fd1312a5c849'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.601922 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] The token cache is being invalidate because project bcc3c564aa2e4f5495de78c2e67db4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:06.602212 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.602896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.604424 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1430/2854] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:06 2022] DELETE /identity/v3/projects/bcc3c564aa2e4f5495de78c2e67db4a3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:06.608523 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:06.618517 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42112891-0420-4e48-92c2-698daac3da73 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:06.678788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:06.679422 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:06.679731 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:06.680115 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] PATH_INFO: `/v3/users/fb371c8bd92b40fe89ef4126d2226b77` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:06.681374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb371c8bd92b40fe89ef4126d2226b77)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:06.683343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:06.733278 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb371c8bd92b40fe89ef4126d2226b77'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.733959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb371c8bd92b40fe89ef4126d2226b77'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.741021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb371c8bd92b40fe89ef4126d2226b77'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.752107 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:06.754775 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb371c8bd92b40fe89ef4126d2226b77'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.756146 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c923b134-1ecd-474e-ba4c-27ede111c21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb371c8bd92b40fe89ef4126d2226b77'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:06.770710 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1425/2855] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:06 2022] DELETE /identity/v3/users/fb371c8bd92b40fe89ef4126d2226b77 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:07.048382 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.050019 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:07.066827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d773-cd73-4a32-a3ab-fd1312a5c849 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.080193 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:07.126389 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.127060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.127340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.127619 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] PATH_INFO: `/v3/projects/2cec767aee72445199ef6907f24af3ec` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.128771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cec767aee72445199ef6907f24af3ec)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.130679 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.180484 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cec767aee72445199ef6907f24af3ec', 'request_id': 'req-0848f167-a5e9-43b7-95fa-7e1508b785c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:07.186029 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cec767aee72445199ef6907f24af3ec', 'request_id': 'req-0848f167-a5e9-43b7-95fa-7e1508b785c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:07.193988 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cec767aee72445199ef6907f24af3ec', 'request_id': 'req-0848f167-a5e9-43b7-95fa-7e1508b785c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:07.206369 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] The token cache is being invalidate because project 2cec767aee72445199ef6907f24af3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:07.206651 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:07.207422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-0848f167-a5e9-43b7-95fa-7e1508b785c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:07.209066 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1431/2856] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:07 2022] DELETE /identity/v3/projects/2cec767aee72445199ef6907f24af3ec => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:07.215200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.215501 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.215777 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.236477 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:07.237694 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:07.297962 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1426/2857] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:07.306164 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.306440 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.306711 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.327130 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:07.328320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:07.337201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1432/2858] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:07.341786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.352295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e8e8-8915-4a13-aaf3-f6fac087c8a2 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.357435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.358043 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.358328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.358600 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.359289 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:01:07.359794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.362506 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.377637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1427/2859] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 12:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:01:07.384218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.398364 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341620-0b63-47a4-ad73-0ff7aef94218 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.404747 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.405356 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.405610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.405883 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.408370 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.410445 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.441396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1433/2860] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:07.445309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.460723 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8bca0-85dd-4d2d-8187-c62e235f6eec admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.520081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.520678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.520947 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.521209 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.521835 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.523817 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.547417 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1428/2861] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:07.551897 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.562840 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f346-3676-4ee3-9eb1-1fc105836210 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.568179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.568775 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.569089 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.569363 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.570006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.571779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.582607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1434/2862] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:07.587465 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.602322 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592690-9510-41ff-ac2f-30995beb7709 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.608142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5e77b-1fc2-4faa-a85c-5f9ce4cfdf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.608770 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e77b-1fc2-4faa-a85c-5f9ce4cfdf0b admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.609309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e77b-1fc2-4faa-a85c-5f9ce4cfdf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.609309 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e77b-1fc2-4faa-a85c-5f9ce4cfdf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.609960 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5e77b-1fc2-4faa-a85c-5f9ce4cfdf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.611616 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5e77b-1fc2-4faa-a85c-5f9ce4cfdf0b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.622916 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1429/2863] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:07.627167 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.637739 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95a4de-8e47-4078-9223-118b24969981 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.642759 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.643406 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.643676 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.643949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] PATH_INFO: `/v3/projects/e6da4ccabedc4186b23841dab65733aa/users/331a8304179e43a982d1777e3ffaf506/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.659777 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6da4ccabedc4186b23841dab65733aa, user_id=331a8304179e43a982d1777e3ffaf506, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.662409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.678905 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1435/2864] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:07 2022] PUT /identity/v3/projects/e6da4ccabedc4186b23841dab65733aa/users/331a8304179e43a982d1777e3ffaf506/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:07.689368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.689657 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.689929 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.726027 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] MFA Rules not processed for user `331a8304179e43a982d1777e3ffaf506`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:07.727471 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:07.774549 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:07.799271 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1430/2865] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:07.804134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.849859 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:07.869991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f7a50-b36a-4617-8549-2cf546677e6f admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.875642 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.876279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.876549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.876817 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.877459 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.879429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:07.908646 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1436/2866] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:07.914056 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:07.925452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638bc22-dd72-4762-8699-9d0cada9ba48 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:07.986347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:07.986997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:07.987276 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:07.987543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:07.988170 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:07.990092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.014952 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1431/2867] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:07 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:08.021402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:08.033625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da67ef-2175-495f-86f6-72abe4d0e114 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:08.039374 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:08.039977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.040256 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.040522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.041173 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:08.042821 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.054429 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1437/2868] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:08.059432 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:08.074585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b2780-25a9-4191-b227-84385f882c5c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:08.080660 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:08.081319 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.081596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.081867 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] PATH_INFO: `/v3/projects/605646092ffa4623b8ae47abe666b60c/users/678a0a3a8664479db7081b33b6365389/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.097689 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605646092ffa4623b8ae47abe666b60c, user_id=678a0a3a8664479db7081b33b6365389, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:08.100512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.116802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1432/2869] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:08 2022] PUT /identity/v3/projects/605646092ffa4623b8ae47abe666b60c/users/678a0a3a8664479db7081b33b6365389/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:08.121095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:08.131904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb572c6-9292-473e-b0ee-6b2333e3ecc5 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:08.191501 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec145da1-da17-43c8-bf1c-d755d246f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:08.192125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec145da1-da17-43c8-bf1c-d755d246f2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.192402 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec145da1-da17-43c8-bf1c-d755d246f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.192669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec145da1-da17-43c8-bf1c-d755d246f2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.193314 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec145da1-da17-43c8-bf1c-d755d246f2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:08.195004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec145da1-da17-43c8-bf1c-d755d246f2a3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.207113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1438/2870] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:08.211711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:08.223343 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8148a6-202b-4f9d-95bd-b03f780abf20 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:08.228893 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:08.229550 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.229824 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.230071 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] PATH_INFO: `/v3/projects/605646092ffa4623b8ae47abe666b60c/users/678a0a3a8664479db7081b33b6365389/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.232181 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605646092ffa4623b8ae47abe666b60c, user_id=678a0a3a8664479db7081b33b6365389, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:08.234913 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.247096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1433/2871] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:08 2022] PUT /identity/v3/projects/605646092ffa4623b8ae47abe666b60c/users/678a0a3a8664479db7081b33b6365389/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:08.318312 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.318562 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.318756 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.350008 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] MFA Rules not processed for user `678a0a3a8664479db7081b33b6365389`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:08.351310 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:08.428974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1439/2872] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:08 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:08.439968 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:08.441785 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:08.499958 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da063ca-7095-4a8c-98d2-4d3fd8136ec2 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:08.503774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:08.504379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.504655 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.504921 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.513966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:08.515425 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.524802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1434/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 12:01:08.683892 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:08.694477 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc62f19-92fa-4554-93e1-fc42bf729ec7 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:08.698876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13cbb-31ad-48a9-a751-a26e18442c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:08.699480 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13cbb-31ad-48a9-a751-a26e18442c12 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:08.699758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13cbb-31ad-48a9-a751-a26e18442c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:08.700030 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13cbb-31ad-48a9-a751-a26e18442c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:08.734867 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:08.759391 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13cbb-31ad-48a9-a751-a26e18442c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:08.760837 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13cbb-31ad-48a9-a751-a26e18442c12 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:08.769904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1440/2874] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:14.360155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:14.402640 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:14.425821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3496a2-f652-4130-b880-643e4e5c67f7 service cinder] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:14.431674 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:14.432302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:14.432587 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:14.432856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] PATH_INFO: `/v3/users/331a8304179e43a982d1777e3ffaf506` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:14.434128 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=331a8304179e43a982d1777e3ffaf506)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:14.436122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:14.487994 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331a8304179e43a982d1777e3ffaf506'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:14.488633 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331a8304179e43a982d1777e3ffaf506'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:14.495543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331a8304179e43a982d1777e3ffaf506'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:14.507176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331a8304179e43a982d1777e3ffaf506'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:14.507805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331a8304179e43a982d1777e3ffaf506'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:14.524091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1435/2875] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:14 2022] DELETE /identity/v3/users/331a8304179e43a982d1777e3ffaf506 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:14.528856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:14.529379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:14.529379 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:14.548766 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:14.549991 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:14.611060 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1441/2876] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 12:01:14.623583 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:14.625103 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:14.684302 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be1144-715c-4d83-9eac-563ba2c2ca39 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:14.688839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:14.689442 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:14.689712 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:14.689978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:14.699905 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:14.701389 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:14.711730 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1436/2877] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:14.982194 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:14.983652 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:14.995970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0d8a7-a3f8-4283-98bb-9ff0ea2434a9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:15.000741 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:15.001452 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:15.001732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:15.002004 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] PATH_INFO: `/v3/projects/e6da4ccabedc4186b23841dab65733aa` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:15.003175 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6da4ccabedc4186b23841dab65733aa)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:15.005127 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:15.053219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6da4ccabedc4186b23841dab65733aa', 'request_id': 'req-787e85f0-652d-4e5b-b711-0781091fa9c5'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.058896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6da4ccabedc4186b23841dab65733aa', 'request_id': 'req-787e85f0-652d-4e5b-b711-0781091fa9c5'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.067024 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6da4ccabedc4186b23841dab65733aa', 'request_id': 'req-787e85f0-652d-4e5b-b711-0781091fa9c5'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.077920 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] The token cache is being invalidate because project e6da4ccabedc4186b23841dab65733aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:15.078204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.078879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.080724 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1442/2878] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:14 2022] DELETE /identity/v3/projects/e6da4ccabedc4186b23841dab65733aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:15.084827 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:15.095316 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095b1d8-f445-4017-81a4-724416977fed service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:15.153796 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:15.154431 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:15.154711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:15.155021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] PATH_INFO: `/v3/users/678a0a3a8664479db7081b33b6365389` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:15.156229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=678a0a3a8664479db7081b33b6365389)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:15.158361 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:15.159964 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:15.208832 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678a0a3a8664479db7081b33b6365389'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.209470 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678a0a3a8664479db7081b33b6365389'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.216421 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678a0a3a8664479db7081b33b6365389'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.228279 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678a0a3a8664479db7081b33b6365389'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.228845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-d0c71b9c-cd61-4dc1-abac-0586c8b12b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678a0a3a8664479db7081b33b6365389'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.242234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1437/2879] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:15 2022] DELETE /identity/v3/users/678a0a3a8664479db7081b33b6365389 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:15.795340 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:15.796847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:15.811930 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e85f0-652d-4e5b-b711-0781091fa9c5 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:15.883021 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:15.883658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:15.883951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:15.884220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] PATH_INFO: `/v3/projects/605646092ffa4623b8ae47abe666b60c` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:15.885455 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605646092ffa4623b8ae47abe666b60c)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:15.887548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:15.889081 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:15.943163 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605646092ffa4623b8ae47abe666b60c', 'request_id': 'req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.951302 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605646092ffa4623b8ae47abe666b60c', 'request_id': 'req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.960524 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605646092ffa4623b8ae47abe666b60c', 'request_id': 'req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.971995 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] The token cache is being invalidate because project 605646092ffa4623b8ae47abe666b60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:15.972283 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.972956 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d6e57af7-47a2-4c5f-aa85-0afdbdfa0864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:15.974498 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1443/2880] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:15 2022] DELETE /identity/v3/projects/605646092ffa4623b8ae47abe666b60c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:15.979533 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:15.980050 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:15.980166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.000351 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:16.001560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:16.064516 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1438/2881] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 12:01:16.075839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.076120 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.076387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.098143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:16.099396 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:16.107951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1444/2882] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:16.112300 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.123347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119861a-46ff-49e3-ac5a-913e065d0ae5 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.129384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.129992 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.130273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.130543 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.131224 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:01:16.131531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.133155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.145466 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1439/2883] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:01:16.149655 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.159528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71772b-087b-4dd4-b0a2-7692b6f73b65 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.165549 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.166141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.166414 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.166704 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.167353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.169255 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.208734 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1445/2884] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:16.217200 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.228109 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b15a7-65cb-413d-af93-cf12a2159b87 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.293369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.293946 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.294262 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.294527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.295185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.297141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.308846 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:16.323406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1440/2885] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:16 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:16.327535 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.338869 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6767-f02b-4241-b1e2-2a5f8b103742 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.345016 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.345621 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.345896 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.346151 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.346827 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.348453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.358706 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1446/2886] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:16.362774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.373520 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272cf61-f364-463c-85c4-5fc2222be761 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.378959 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dd06c-9791-41e4-81fe-ccaf0125b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.379555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd06c-9791-41e4-81fe-ccaf0125b94f admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.379837 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd06c-9791-41e4-81fe-ccaf0125b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.380112 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dd06c-9791-41e4-81fe-ccaf0125b94f admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.380750 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd06c-9791-41e4-81fe-ccaf0125b94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.382350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dd06c-9791-41e4-81fe-ccaf0125b94f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.393075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1441/2887] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:16.397174 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.407333 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3fb13-4f61-47c3-bfd5-a79e0c30352e admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.412298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.412942 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.413219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.413485 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] PATH_INFO: `/v3/projects/df7eba138137467b8985358a0c187135/users/c60eb51f021740f7b2d4c427e55a3855/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.428243 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7eba138137467b8985358a0c187135, user_id=c60eb51f021740f7b2d4c427e55a3855, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.430936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.446296 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1447/2888] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:16 2022] PUT /identity/v3/projects/df7eba138137467b8985358a0c187135/users/c60eb51f021740f7b2d4c427e55a3855/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:16.452335 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb5452-bbed-4907-834f-d3453616eadf None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.452880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb5452-bbed-4907-834f-d3453616eadf None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.453267 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb5452-bbed-4907-834f-d3453616eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.477540 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-5bdb5452-bbed-4907-834f-d3453616eadf None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:16.478807 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-5bdb5452-bbed-4907-834f-d3453616eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:16.543063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1442/2889] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:16.553328 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:16.555487 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:16.621758 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842ffc-3ffa-4f6b-aa20-19b7756481e7 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:16.625610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:16.626215 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:16.626488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:16.626781 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:16.636143 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:16.637637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:16.647170 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1448/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:17.304808 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.305379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.305379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.336988 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] MFA Rules not processed for user `c60eb51f021740f7b2d4c427e55a3855`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:17.338233 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:17.402311 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1443/2891] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:17.407105 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:17.418027 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bddd28-8ea3-48fa-8fbf-2996fed44390 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:17.423053 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:17.423660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.423969 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.424213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.424994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:17.426947 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:17.459191 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1449/2892] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:17 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:17.460939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:17.473353 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413465b-6c6c-4208-913b-67b8fa957fde None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:17.530379 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:17.531061 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.531341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.531611 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.532243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:17.534218 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:17.558063 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1444/2893] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:17 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:17.563178 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:17.574162 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69ea4-1205-40cd-9ebf-49ce44505d09 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:17.580683 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:17.581280 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.581557 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.581806 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.582458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:17.584110 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:17.585504 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:17.600625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1450/2894] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:17.601920 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:17.609358 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:17.613504 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d939-e545-4ce6-a0e6-adf7eea93b7b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:17.620691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:17.621368 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.621706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.621963 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] PATH_INFO: `/v3/projects/475b8cd8776641ed934253cdfe12ea5a/users/908f05cd6afa4a8c962e24412f5e1556/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.638195 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475b8cd8776641ed934253cdfe12ea5a, user_id=908f05cd6afa4a8c962e24412f5e1556, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:17.640877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:17.656029 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1445/2895] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:17 2022] PUT /identity/v3/projects/475b8cd8776641ed934253cdfe12ea5a/users/908f05cd6afa4a8c962e24412f5e1556/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 12:01:17.660278 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:17.670779 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e773-9d1a-4f09-b278-2f3c0bdba8f3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:17.728282 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc6a60-2839-4783-9af2-cc9b96e04509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:17.728910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc6a60-2839-4783-9af2-cc9b96e04509 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.729179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc6a60-2839-4783-9af2-cc9b96e04509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.729448 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc6a60-2839-4783-9af2-cc9b96e04509 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.730078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc6a60-2839-4783-9af2-cc9b96e04509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:17.731714 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc6a60-2839-4783-9af2-cc9b96e04509 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:17.741460 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1451/2896] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:17.745792 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:17.756704 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab981e9d-8478-474a-a7cc-00d1dbf647a2 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:17.762489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dffda-ebd8-4d97-9918-35d0cc0429d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:17.763250 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dffda-ebd8-4d97-9918-35d0cc0429d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:17.763548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dffda-ebd8-4d97-9918-35d0cc0429d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:17.763821 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dffda-ebd8-4d97-9918-35d0cc0429d5 admin admin] PATH_INFO: `/v3/projects/475b8cd8776641ed934253cdfe12ea5a/users/908f05cd6afa4a8c962e24412f5e1556/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:17.765869 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dffda-ebd8-4d97-9918-35d0cc0429d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475b8cd8776641ed934253cdfe12ea5a, user_id=908f05cd6afa4a8c962e24412f5e1556, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:17.768562 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dffda-ebd8-4d97-9918-35d0cc0429d5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:17.779304 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1446/2897] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:17 2022] PUT /identity/v3/projects/475b8cd8776641ed934253cdfe12ea5a/users/908f05cd6afa4a8c962e24412f5e1556/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:18.412563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:18.413113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:18.413113 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:18.442290 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] MFA Rules not processed for user `908f05cd6afa4a8c962e24412f5e1556`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:18.443567 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:18.511974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1452/2898] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:18.522579 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:18.523131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:18.523131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:18.542856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] MFA Rules not processed for user `c60eb51f021740f7b2d4c427e55a3855`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:18.544022 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:18.601126 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1447/2899] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:18.612656 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:18.614052 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:18.691665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390169ac-834c-4f90-a429-cb0c6c30f641 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:18.697776 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:18.698387 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:18.698665 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:18.698970 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:18.707189 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:18.708783 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:18.718064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1453/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:18.957053 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:19.019546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c61d7-00f6-4e91-ab67-5f7c7de56b76 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:19.024253 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:19.024872 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:19.025152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:19.025449 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:19.027495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:19.037357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:19.038833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:19.047134 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1448/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:28.714006 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=99 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:29.043739 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:32.875845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:32.877948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:32.943399 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf081a-9938-4eec-8fad-3f944f3a4ee2 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:32.947951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:32.948551 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:32.948853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:32.949095 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:32.961761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:32.964124 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:32.979618 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1454/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:42.972996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=26 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:52.941593 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:53.005374 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93ece9-3cc6-4486-b3d8-b2e08e5dd90b service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:53.010229 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:53.010943 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:53.011252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:53.011527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] PATH_INFO: `/v3/users/c60eb51f021740f7b2d4c427e55a3855` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:53.012721 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60eb51f021740f7b2d4c427e55a3855)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:53.014759 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:53.064398 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60eb51f021740f7b2d4c427e55a3855'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.065036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60eb51f021740f7b2d4c427e55a3855'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.071771 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60eb51f021740f7b2d4c427e55a3855'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.084737 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60eb51f021740f7b2d4c427e55a3855'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.085467 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60eb51f021740f7b2d4c427e55a3855'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.099651 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1449/2903] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:52 2022] DELETE /identity/v3/users/c60eb51f021740f7b2d4c427e55a3855 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:53.287400 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:53.304412 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d186-0cf9-4d9b-a28a-de12e53b8f2a service cinder] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:53.388014 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:53.388871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:53.389225 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:53.389520 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] PATH_INFO: `/v3/projects/df7eba138137467b8985358a0c187135` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:53.391541 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7eba138137467b8985358a0c187135)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:53.394593 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:53.446479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7eba138137467b8985358a0c187135', 'request_id': 'req-3cf97acc-fcea-403c-8d4d-10a82f6449b9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.452887 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7eba138137467b8985358a0c187135', 'request_id': 'req-3cf97acc-fcea-403c-8d4d-10a82f6449b9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.460723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7eba138137467b8985358a0c187135', 'request_id': 'req-3cf97acc-fcea-403c-8d4d-10a82f6449b9'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.472009 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] The token cache is being invalidate because project df7eba138137467b8985358a0c187135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:53.472304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.472966 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.474479 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1455/2904] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:53 2022] DELETE /identity/v3/projects/df7eba138137467b8985358a0c187135 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 12:01:53.478719 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:53.480413 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:53.494678 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d77fd5-0d1b-4634-b6d5-2e370be3c96f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:53.550531 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:53.551176 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:53.551452 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:53.551718 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] PATH_INFO: `/v3/users/908f05cd6afa4a8c962e24412f5e1556` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:53.552949 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=908f05cd6afa4a8c962e24412f5e1556)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:53.554922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:53.575654 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:53.604186 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908f05cd6afa4a8c962e24412f5e1556'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.604878 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908f05cd6afa4a8c962e24412f5e1556'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.611914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908f05cd6afa4a8c962e24412f5e1556'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.623716 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908f05cd6afa4a8c962e24412f5e1556'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.624412 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-e838273d-aed6-4540-b5b2-0cf6d8b4a137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908f05cd6afa4a8c962e24412f5e1556'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.640758 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1450/2905] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:53 2022] DELETE /identity/v3/users/908f05cd6afa4a8c962e24412f5e1556 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:53.817616 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:53.819332 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:53.834269 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97acc-fcea-403c-8d4d-10a82f6449b9 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:53.897658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:53.898293 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:53.898570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:53.898871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] PATH_INFO: `/v3/projects/475b8cd8776641ed934253cdfe12ea5a` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:53.900000 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] RBAC: Authorizing `identity:delete_project(project_id=475b8cd8776641ed934253cdfe12ea5a)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:53.901929 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:53.941375 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:53.955201 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475b8cd8776641ed934253cdfe12ea5a', 'request_id': 'req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.960594 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475b8cd8776641ed934253cdfe12ea5a', 'request_id': 'req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.968252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475b8cd8776641ed934253cdfe12ea5a', 'request_id': 'req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.985026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] The token cache is being invalidate because project 475b8cd8776641ed934253cdfe12ea5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:53.985320 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.985967 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-9319c04c-d3b1-4ae6-8b7f-67097c06cfea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:53.987529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1456/2906] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:53 2022] DELETE /identity/v3/projects/475b8cd8776641ed934253cdfe12ea5a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:53.992781 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:53.993313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:53.993313 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.014017 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:54.015285 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:54.078019 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1451/2907] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:54.085946 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.086228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.086497 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.108157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:54.109377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:54.119017 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1457/2908] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:54.124091 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.138951 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd79c2-47ca-4aba-b88f-bb859ed8b6ce None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.147438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.148242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.148556 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.148875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.149925 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:01:54.150243 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.151890 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.164208 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1452/2909] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 12:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:01:54.168879 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.178644 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756b25-37cb-4857-9a50-3a1997289b51 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.184705 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.185299 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.185569 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.185839 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.186467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.188422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.220570 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1458/2910] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:54 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:54.224675 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.235098 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e52d-ffd9-4d40-a275-2a1bdd4ee651 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.301914 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.302875 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.303266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.303662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.304639 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.307259 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.332594 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1453/2911] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:54 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:54.338617 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.349393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a528f3-57b7-4157-bd38-9cda7069ad37 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.354607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.355304 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.355579 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.355846 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.356486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.358078 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.368070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1459/2912] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:54.372015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.382559 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bd70-b639-4066-aaa5-9f64aa7f16c9 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.388137 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7433a2-c716-4f04-8130-5a76031a7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.388757 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7433a2-c716-4f04-8130-5a76031a7785 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.389051 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7433a2-c716-4f04-8130-5a76031a7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.389321 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7433a2-c716-4f04-8130-5a76031a7785 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.389967 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7433a2-c716-4f04-8130-5a76031a7785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.391601 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7433a2-c716-4f04-8130-5a76031a7785 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.402265 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1454/2913] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:54.406301 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.416824 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f3aa-3890-42fc-a6e8-ac22b33942f3 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.422345 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.423034 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.423336 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.423608 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] PATH_INFO: `/v3/projects/efd830fc5c1e4111877b83f7148fcb71/users/ba1dab970f4c42fa9ae0a16eeb288280/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.439639 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd830fc5c1e4111877b83f7148fcb71, user_id=ba1dab970f4c42fa9ae0a16eeb288280, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.442288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.456736 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1460/2914] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:54 2022] PUT /identity/v3/projects/efd830fc5c1e4111877b83f7148fcb71/users/ba1dab970f4c42fa9ae0a16eeb288280/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:54.467347 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.467635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.467924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.476512 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:54.498629 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] MFA Rules not processed for user `ba1dab970f4c42fa9ae0a16eeb288280`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:54.500155 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:54.568511 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1455/2915] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:54.580635 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.582526 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:54.642492 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78bcd4-3836-4bac-9204-e2c0818acaea admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.646653 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7e4cb-0a81-4bc3-87b8-a07c31128ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c4d2542f6145c38255de0387094e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.647295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7e4cb-0a81-4bc3-87b8-a07c31128ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.647572 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7e4cb-0a81-4bc3-87b8-a07c31128ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.647843 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7e4cb-0a81-4bc3-87b8-a07c31128ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.656418 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7e4cb-0a81-4bc3-87b8-a07c31128ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.657852 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7e4cb-0a81-4bc3-87b8-a07c31128ea8 service cinder] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.667994 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1461/2916] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:54.694206 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.759576 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36717287-6b47-4e06-81c5-669390a516e7 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:54.764634 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:54.765266 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.765548 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.765813 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] PATH_INFO: `/v3/users/ba1dab970f4c42fa9ae0a16eeb288280` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.767036 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1dab970f4c42fa9ae0a16eeb288280)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:54.768970 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:54.819644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1dab970f4c42fa9ae0a16eeb288280'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:54.820312 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1dab970f4c42fa9ae0a16eeb288280'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:54.827101 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1dab970f4c42fa9ae0a16eeb288280'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:54.840643 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1dab970f4c42fa9ae0a16eeb288280'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:54.841391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1dab970f4c42fa9ae0a16eeb288280'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:54.856153 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1456/2917] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:01:54 2022] DELETE /identity/v3/users/ba1dab970f4c42fa9ae0a16eeb288280 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:54.862898 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:54.863190 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:54.863564 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:54.885001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:54.886219 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:54.949851 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:54.960222 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1462/2918] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:54.971409 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:54.973097 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:54.989014 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:55.038996 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683b981-3389-4b41-af88-1150c2efb40f admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.042997 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d55bb1-3789-4af9-ac06-d320de9a2458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.043607 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d55bb1-3789-4af9-ac06-d320de9a2458 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.043883 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d55bb1-3789-4af9-ac06-d320de9a2458 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.044152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d55bb1-3789-4af9-ac06-d320de9a2458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.053252 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d55bb1-3789-4af9-ac06-d320de9a2458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.054765 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d55bb1-3789-4af9-ac06-d320de9a2458 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.068940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1457/2919] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:01:55.359072 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.360607 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:55.373528 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c99b-e87d-4be2-9a3b-5215ede03e0f None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.379285 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.380012 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.380354 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.380632 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] PATH_INFO: `/v3/projects/efd830fc5c1e4111877b83f7148fcb71` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.381962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd830fc5c1e4111877b83f7148fcb71)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.384444 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.433650 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd830fc5c1e4111877b83f7148fcb71', 'request_id': 'req-d437977d-fab6-4e89-9cc8-eb1ff80c673b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:55.439134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd830fc5c1e4111877b83f7148fcb71', 'request_id': 'req-d437977d-fab6-4e89-9cc8-eb1ff80c673b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:55.448064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd830fc5c1e4111877b83f7148fcb71', 'request_id': 'req-d437977d-fab6-4e89-9cc8-eb1ff80c673b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:55.459894 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] The token cache is being invalidate because project efd830fc5c1e4111877b83f7148fcb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:01:55.460179 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:55.460790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-d437977d-fab6-4e89-9cc8-eb1ff80c673b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:01:55.462351 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1463/2920] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:01:55 2022] DELETE /identity/v3/projects/efd830fc5c1e4111877b83f7148fcb71 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:55.467685 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.467972 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.468247 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.489373 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:55.490597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:55.550364 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1458/2921] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:55.559931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.560218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.560493 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.581949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:55.583221 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:55.591841 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1464/2922] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:01:55.596034 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.609939 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd187-e553-4641-bc26-a140ea825100 None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.615977 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.616585 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.616859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.617130 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.617774 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88033) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:01:55.618076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.619776 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.631788 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1459/2923] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 6 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:01:55.636230 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.645923 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c63d7-61a6-4886-a7bc-ecb94b58c9e9 None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.651214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.651813 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.652087 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.652353 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.652971 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.654931 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.684962 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1465/2924] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:01:55 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:55.690880 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.705527 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f304d1-2249-4e7e-9e4e-737c8c10dc12 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.766052 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.766708 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.766993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.767268 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.767909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.769877 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.792084 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1460/2925] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:01:55 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:01:55.796298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.806847 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db03bc-5b39-435f-a467-f5b2bcee0165 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.811810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.812397 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.812671 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.812925 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.813573 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.815217 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.825540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1466/2926] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 12:01:55.829924 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.840149 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48400f-9e9b-477f-a572-cc6f8c342d6d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.845350 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27363c-2307-44c2-ac2b-44d84f825179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.845933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27363c-2307-44c2-ac2b-44d84f825179 admin admin] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.846207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27363c-2307-44c2-ac2b-44d84f825179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.846475 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27363c-2307-44c2-ac2b-44d84f825179 admin admin] PATH_INFO: `/v3/roles` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.847159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27363c-2307-44c2-ac2b-44d84f825179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.848756 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27363c-2307-44c2-ac2b-44d84f825179 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.859359 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1461/2927] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:01:55.863636 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:55.874547 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bee2-6531-41ea-938f-da6415d268f8 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:55.880563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:55.881204 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] REQUEST_METHOD: `PUT` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.881486 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.881748 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] PATH_INFO: `/v3/projects/950145eb40374db0b4072421909a6b36/users/e6fd6a266a9343d284fd27e565b57f8a/roles/7a9fe76f438347f8a55ca531d152d5c2` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.898377 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] RBAC: Authorizing `identity:create_grant(project_id=950145eb40374db0b4072421909a6b36, user_id=e6fd6a266a9343d284fd27e565b57f8a, role_id=7a9fe76f438347f8a55ca531d152d5c2)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:55.901097 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:55.915767 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1467/2928] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:01:55 2022] PUT /identity/v3/projects/950145eb40374db0b4072421909a6b36/users/e6fd6a266a9343d284fd27e565b57f8a/roles/7a9fe76f438347f8a55ca531d152d5c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:01:55.921717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9968c6-ad1e-41e3-8aec-f220a23fb6f4 None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:55.922124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9968c6-ad1e-41e3-8aec-f220a23fb6f4 None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:55.922453 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9968c6-ad1e-41e3-8aec-f220a23fb6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:55.951642 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-6e9968c6-ad1e-41e3-8aec-f220a23fb6f4 None None] MFA Rules not processed for user `998dc91652fe4a80ad7901f3f3010bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:01:55.953859 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6e9968c6-ad1e-41e3-8aec-f220a23fb6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:55.980242 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:56.023083 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1462/2929] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 12:01:56.033064 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:01:56.035077 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:01:56.093385 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18bd5-a35b-43b8-8e21-503eeb35deba admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:01:56.097534 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:01:56.098125 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:01:56.098393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:01:56.098660 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:01:56.108289 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:01:56.109712 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:01:56.119257 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1468/2930] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:02:00.038357 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.038935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.038935 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.073158 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.auth.core [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] MFA Rules not processed for user `e6fd6a266a9343d284fd27e565b57f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=88033) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:02:00.074411 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:00.158839 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1463/2931] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:02:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:02:00.161144 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:00.171658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a0f9-3c39-45be-89b5-f8f278412b19 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:00.176488 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:00.177100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.177384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.177654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.178401 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:00.180422 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:00.203324 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:00.211252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1469/2932] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 6 12:02:00 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:02:00.215024 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:00.226582 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72d1e-d081-40f2-9510-d8037a5f6bea None None] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:00.285207 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:00.285746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] REQUEST_METHOD: `POST` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.286028 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.286295 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] PATH_INFO: `/v3/users` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.286971 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:00.288919 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:00.312805 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1464/2933] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 6 12:02:00 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 12:02:00.316732 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:00.328552 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ebde-ab59-4230-86ec-9101bcae98fa admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:00.333252 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:00.333865 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.334141 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.334409 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.335101 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:00.336715 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:00.348857 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1470/2934] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:02:00.353180 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:00.364602 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d941503-edf2-41e3-ad5a-8874920b393d admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:00.370255 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:00.371635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.372141 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.372625 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] PATH_INFO: `/v3/projects/36e31587cf964f2389c14fa7c9587433/users/c9135d828b4a43b08c018c708d4705f9/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.392012 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e31587cf964f2389c14fa7c9587433, user_id=c9135d828b4a43b08c018c708d4705f9, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:00.394845 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:00.411458 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1465/2935] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:02:00 2022] PUT /identity/v3/projects/36e31587cf964f2389c14fa7c9587433/users/c9135d828b4a43b08c018c708d4705f9/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:02:00.415796 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:00.426713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d06bfc-f8fc-4482-aed4-c73b047d3806 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:00.486235 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd151d75-d60d-40e0-94ea-497869c648e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:00.486904 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151d75-d60d-40e0-94ea-497869c648e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.487182 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151d75-d60d-40e0-94ea-497869c648e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.487453 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151d75-d60d-40e0-94ea-497869c648e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.488109 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151d75-d60d-40e0-94ea-497869c648e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:00.489721 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151d75-d60d-40e0-94ea-497869c648e7 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:00.500372 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1471/2936] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 6 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:02:00.504717 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:00.515427 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a3ef5-810b-4dfc-a2c1-5cbc0f0013d5 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:00.520261 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:00.520911 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] REQUEST_METHOD: `PUT` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:00.521182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:00.521456 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] PATH_INFO: `/v3/projects/36e31587cf964f2389c14fa7c9587433/users/c9135d828b4a43b08c018c708d4705f9/roles/ca613b7a99764a02bc3ffa26b302575a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:00.523468 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e31587cf964f2389c14fa7c9587433, user_id=c9135d828b4a43b08c018c708d4705f9, role_id=ca613b7a99764a02bc3ffa26b302575a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:00.526076 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:00.536502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1466/2937] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 6 12:02:00 2022] PUT /identity/v3/projects/36e31587cf964f2389c14fa7c9587433/users/c9135d828b4a43b08c018c708d4705f9/roles/ca613b7a99764a02bc3ffa26b302575a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:02:04.934228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f501c80-78bd-458b-8474-dd38d8fac17a None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:04.934853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f501c80-78bd-458b-8474-dd38d8fac17a None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:04.934853 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f501c80-78bd-458b-8474-dd38d8fac17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:04.971696 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-0f501c80-78bd-458b-8474-dd38d8fac17a None None] MFA Rules not processed for user `c9135d828b4a43b08c018c708d4705f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:02:04.972977 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-0f501c80-78bd-458b-8474-dd38d8fac17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:05.073274 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1472/2938] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:02:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:02:05.085982 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:05.089691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:05.100221 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:05.183201 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5071-a2ce-450c-9a1e-04a30d97b06c admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:05.189748 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:05.190375 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:05.190648 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:05.190940 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:05.259078 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:05.261182 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:05.272236 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1467/2939] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:02:08.068849 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b260-2992-4ced-be0f-13d3d20a8161 None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:08.069360 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b260-2992-4ced-be0f-13d3d20a8161 None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:08.069458 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b260-2992-4ced-be0f-13d3d20a8161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:08.095791 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2633b260-2992-4ced-be0f-13d3d20a8161 None None] MFA Rules not processed for user `e6fd6a266a9343d284fd27e565b57f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:02:08.097073 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2633b260-2992-4ced-be0f-13d3d20a8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:08.105218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1473/2940] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 6 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:02:14.058447 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:14.060096 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:14.134945 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df358-ed92-4e98-b3f3-0e5509ff7bf0 service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:14.140668 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:14.141325 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:14.141635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:14.141897 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:14.143764 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:14.156637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:14.158272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:14.171909 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1468/2941] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:02:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:02:14.949927 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] REQUEST_METHOD: `POST` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:14.950474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:14.950474 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:14.972877 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.auth.core [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] MFA Rules not processed for user `42e4f3e4ddd34ad689319b863afd6db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:02:14.974122 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:15.036288 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1474/2942] 10.222.0.49 () {58 vars in 967 bytes} [Tue Sep 6 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:02:15.077089 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:15.078744 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:15.114282 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=100 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:15.153099 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ac62-dc27-4173-9411-ee7eed8cc817 service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:15.158641 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc527e0ec230497cb664de8ea319ba7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:15.159272 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:15.159546 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:15.159810 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:15.167833 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:15.169522 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:15.178367 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1469/2943] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Sep 6 12:02:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:02:21.823471 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:21.825023 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:21.841478 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:21.913587 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeb207-fc3a-4d41-a0a0-adb6fcd1fb5c None None] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:21.918325 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:21.919001 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:21.919309 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:21.919713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] PATH_INFO: `/v3/users/5624b84c8e2947f3902035827e42884b` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:21.920908 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5624b84c8e2947f3902035827e42884b)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:21.922902 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:21.972522 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5624b84c8e2947f3902035827e42884b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:21.973176 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5624b84c8e2947f3902035827e42884b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:21.980114 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5624b84c8e2947f3902035827e42884b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:21.991948 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5624b84c8e2947f3902035827e42884b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:21.992625 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5624b84c8e2947f3902035827e42884b'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.007224 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1475/2944] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:02:21 2022] DELETE /identity/v3/users/5624b84c8e2947f3902035827e42884b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:02:22.201850 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:22.221496 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2757dab-abc3-4671-a8d5-0021bd02433b service swift] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:22.286249 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:22.287020 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:22.287294 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:22.287560 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] PATH_INFO: `/v3/projects/e4a8677ec9c34caba7bcda7ccba3625e` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:22.288661 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a8677ec9c34caba7bcda7ccba3625e)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:22.290706 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:22.341438 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a8677ec9c34caba7bcda7ccba3625e', 'request_id': 'req-11fd7893-bfd5-4f48-9fd1-5722e83022b3'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.347045 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a8677ec9c34caba7bcda7ccba3625e', 'request_id': 'req-11fd7893-bfd5-4f48-9fd1-5722e83022b3'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.355590 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a8677ec9c34caba7bcda7ccba3625e', 'request_id': 'req-11fd7893-bfd5-4f48-9fd1-5722e83022b3'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.369979 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] The token cache is being invalidate because project e4a8677ec9c34caba7bcda7ccba3625e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:02:22.370296 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.373328 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.374889 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1470/2945] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:02:22 2022] DELETE /identity/v3/projects/e4a8677ec9c34caba7bcda7ccba3625e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:02:22.379888 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:22.381371 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:22.394861 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9dca9-df6a-412a-8f6d-fc6c073450e2 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:22.458794 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:22.459447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:22.459723 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:22.459996 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] PATH_INFO: `/v3/users/bb169ebff036441e9eb1831409cdf7c8` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:22.461192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb169ebff036441e9eb1831409cdf7c8)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:22.463185 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:22.500489 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:22.514790 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb169ebff036441e9eb1831409cdf7c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.515465 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb169ebff036441e9eb1831409cdf7c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.522322 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb169ebff036441e9eb1831409cdf7c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.534973 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb169ebff036441e9eb1831409cdf7c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.535628 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb169ebff036441e9eb1831409cdf7c8'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.549200 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1476/2946] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:02:22 2022] DELETE /identity/v3/users/bb169ebff036441e9eb1831409cdf7c8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:02:22.727502 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:22.729006 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:22.747836 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7893-bfd5-4f48-9fd1-5722e83022b3 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:22.796486 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:22.808087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:22.808794 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:22.809234 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:22.809503 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] PATH_INFO: `/v3/projects/ff714768b273400e859ce9722940d858` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:22.810665 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff714768b273400e859ce9722940d858)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:22.812637 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:22.860621 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff714768b273400e859ce9722940d858', 'request_id': 'req-12a61930-a5ea-4a6c-8000-5d204efe01fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.865886 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff714768b273400e859ce9722940d858', 'request_id': 'req-12a61930-a5ea-4a6c-8000-5d204efe01fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.871922 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff714768b273400e859ce9722940d858', 'request_id': 'req-12a61930-a5ea-4a6c-8000-5d204efe01fd'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.885726 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] The token cache is being invalidate because project ff714768b273400e859ce9722940d858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88033) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:02:22.886015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.886715 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:02:22.888290 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1471/2947] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:02:22 2022] DELETE /identity/v3/projects/ff714768b273400e859ce9722940d858 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:02:32.546126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=18,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:32.882519 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:39.419856 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:39.421529 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:39.482540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2e550-07de-46c7-b695-f390695a9b1a admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:39.531940 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:39.532561 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:39.532845 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:39.533112 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:39.535315 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:39.600871 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:39.602361 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:39.612192 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1477/2948] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:02:49.607976 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=70 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:27.603966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:04:27.605666 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:04:27.619193 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a61930-a5ea-4a6c-8000-5d204efe01fd admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:04:27.623274 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:04:27.623896 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:04:27.624160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:04:27.624430 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:04:27.626284 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:04:27.636122 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:04:27.637598 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:04:27.645891 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1472/2949] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:04:37.642171 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=6 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:04.174710 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:04.176126 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:04.187330 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3424-8a6e-4ccd-ae55-d4aa57b88ca9 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:04.191137 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:04.191761 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:04.192038 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:04.192306 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:04.194100 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:04.265447 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:04.266802 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:04.278184 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1478/2950] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:05.490075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:05.501235 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32fee-c76c-49b7-9c4b-c7da7d3a3412 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:05.511406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:05.512283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:05.512644 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:05.513082 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:05.515489 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:05.531092 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:05.532545 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:05.544140 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1473/2951] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:14.273393 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=34 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:15.538555 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=6 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:17.637563 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:17.650949 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dd712-2b27-43fc-a0fa-ff67ac29ccfe service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:17.656834 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:17.657436 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:17.657707 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:17.657974 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:17.660152 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:17.670658 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:17.672346 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:17.680810 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1479/2952] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:17.811100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:17.820384 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0f64-d46b-4f34-af6b-d0395e729e26 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:17.824856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:17.825482 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:17.825747 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:17.826015 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:17.828152 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:17.839362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:17.840868 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:17.850131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1474/2953] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:17.962010 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:17.970917 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a369a-4633-478a-a247-03d89c734500 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:17.974637 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:17.975259 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:17.975565 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:17.975833 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:17.977605 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:17.992134 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:17.993610 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:18.004384 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1480/2954] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:18.063406 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:18.064899 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:18.137225 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39ea9-8faf-40b5-a8ae-6da0aab58815 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:18.145161 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:18.145787 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:18.146064 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:18.146369 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:18.148577 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:18.162246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:18.163856 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:18.174366 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1475/2955] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:19.518157 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:19.519785 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:19.537160 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67542b-7b63-4863-892f-1ab22b520193 service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:19.543133 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:19.543751 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:19.544026 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:19.544298 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:19.546076 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:19.559669 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:19.561279 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:19.572919 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1481/2956] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:28.169596 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=38 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:29.568804 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=18 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:07.372075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:07.416933 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536d630-44a9-4bad-acad-e60c69e35601 service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:07.421273 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:07.421892 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:07.422173 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:07.422445 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:07.424444 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:07.510291 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:07.512386 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:07.522160 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1476/2957] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:08.642070 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:08.644592 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:08.760421 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7f113-cf33-49b3-8884-1473bef63a7f service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:08.779218 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:08.779876 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:08.780150 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:08.780415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:08.783441 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:08.799228 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:08.800638 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:08.812140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1482/2958] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:11.086635 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:11.099677 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbbb42-d125-46f7-b469-8818a707b496 service neutron] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:11.105142 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a782787a64c94d0f8a43f7f8deeb120b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:11.105752 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:11.106021 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:11.106283 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:11.108059 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:11.121185 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:11.123075 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:11.134131 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1477/2959] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:12.507674 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:12.517495 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d306037-3b4e-4724-8dff-357a544b3b18 service nova] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:12.521067 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac866c0c1c33423b9ecbf97a3b08240c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:12.521670 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:12.521944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:12.522213 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:12.523944 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:12.609147 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:12.610713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:12.631140 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1483/2960] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:15.750978 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:15.752557 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:15.802931 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9bc3-7646-4d78-9c4a-5cdd1b697c0c service nova] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:15.810664 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:15.811331 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:15.811597 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:15.811864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:15.813711 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:15.826404 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:15.828055 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:15.849344 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1478/2961] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:18.700428 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:18.714578 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42331a-a95f-4d28-a22d-5783d3dc8fce service neutron] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:18.720214 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:18.720926 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] REQUEST_METHOD: `GET` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:18.721199 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:18.721467 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:18.723640 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:18.736581 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:18.738770 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:18.756457 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1484/2962] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:18.770159 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:18.771691 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:18.795100 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85114c8-c91e-47cf-b526-99af27aeaaa5 service placement] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:18.803194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:18.803194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:18.803194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:18.803194 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] PATH_INFO: `/v3/users/e6fd6a266a9343d284fd27e565b57f8a` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:18.804985 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fd6a266a9343d284fd27e565b57f8a)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:18.808246 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:18.857072 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fd6a266a9343d284fd27e565b57f8a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:18.857707 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fd6a266a9343d284fd27e565b57f8a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:18.864966 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fd6a266a9343d284fd27e565b57f8a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:18.867047 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:18.879372 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fd6a266a9343d284fd27e565b57f8a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:18.879993 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fd6a266a9343d284fd27e565b57f8a'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:18.894124 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1479/2963] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:07:18 2022] DELETE /identity/v3/users/e6fd6a266a9343d284fd27e565b57f8a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:07:19.072760 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:19.084284 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd56e-940e-4129-8629-4712fcc18e4e service placement] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:19.115951 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=100 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:19.154148 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:19.154771 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:19.155046 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:19.155313 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] PATH_INFO: `/v3/projects/950145eb40374db0b4072421909a6b36` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:19.156415 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950145eb40374db0b4072421909a6b36)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:19.158540 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:19.207093 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950145eb40374db0b4072421909a6b36', 'request_id': 'req-eb6a5477-1bee-433a-8508-5950bcaf78b4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.212446 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950145eb40374db0b4072421909a6b36', 'request_id': 'req-eb6a5477-1bee-433a-8508-5950bcaf78b4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.224118 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950145eb40374db0b4072421909a6b36', 'request_id': 'req-eb6a5477-1bee-433a-8508-5950bcaf78b4'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.236297 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] The token cache is being invalidate because project 950145eb40374db0b4072421909a6b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:07:19.236590 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.237295 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.238936 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1485/2964] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:07:19 2022] DELETE /identity/v3/projects/950145eb40374db0b4072421909a6b36 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:07:19.243081 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:19.244636 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:19.258786 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be1525-1d63-41a9-8127-7c5bcc0f292b admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:19.320435 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:19.321108 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:19.321391 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:19.321662 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] PATH_INFO: `/v3/users/c9135d828b4a43b08c018c708d4705f9` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:19.322928 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9135d828b4a43b08c018c708d4705f9)` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:19.324870 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:19.372802 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9135d828b4a43b08c018c708d4705f9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.373483 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9135d828b4a43b08c018c708d4705f9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.380446 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9135d828b4a43b08c018c708d4705f9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.392448 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9135d828b4a43b08c018c708d4705f9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.393087 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.notifications [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9135d828b4a43b08c018c708d4705f9'} {{(pid=88033) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.406864 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1480/2965] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 6 12:07:19 2022] DELETE /identity/v3/users/c9135d828b4a43b08c018c708d4705f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 12:07:19.594220 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Authenticating user token {{(pid=88032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:19.595713 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.fernet_utils [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:19.611588 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a5477-1bee-433a-8508-5950bcaf78b4 admin admin] Validating token access rules against request {{(pid=88032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:19.671910 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998dc91652fe4a80ad7901f3f3010bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38d4dcd6a0e45e880f97fafaba71561', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:19.672548 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:19.672866 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] SCRIPT_NAME: `/identity` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:19.673104 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] PATH_INFO: `/v3/projects/36e31587cf964f2389c14fa7c9587433` {{(pid=88032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:19.674210 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e31587cf964f2389c14fa7c9587433)` {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:19.676169 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] RBAC: Authorization granted {{(pid=88032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:19.725334 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e31587cf964f2389c14fa7c9587433', 'request_id': 'req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.730057 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:19.731688 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e31587cf964f2389c14fa7c9587433', 'request_id': 'req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.739667 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e31587cf964f2389c14fa7c9587433', 'request_id': 'req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e'} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.752654 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] The token cache is being invalidate because project 36e31587cf964f2389c14fa7c9587433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:07:19.752939 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.753576 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG keystone.notifications [None req-2d8a3fed-52a9-4067-b28e-b08a8ff5826e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:07:19.755091 dv-cinder-856041-1-smb devstack@keystone.service[88032]: [pid: 88032|app: 0|req: 1486/2966] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 6 12:07:19 2022] DELETE /identity/v3/projects/36e31587cf964f2389c14fa7c9587433 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:07:29.187738 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Authenticating user token {{(pid=88033) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:29.189439 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:29.249362 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:29.266746 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f8fb-12da-4531-a092-1257cdfb0e84 admin admin] Validating token access rules against request {{(pid=88033) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:29.330798 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422e32cb1eb345899ec4f2283d5fe828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf3ef6e507741c091d37eba762dbdc2', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88033) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:29.331341 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] REQUEST_METHOD: `GET` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:29.331612 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] SCRIPT_NAME: `/identity` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:29.331882 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88033) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:29.333822 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.fernet_utils [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88033) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:29.345495 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:29.347188 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122c96-baea-42f7-a42d-4e86afecb8d0 service placement] RBAC: Authorization granted {{(pid=88033) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:29.357334 dv-cinder-856041-1-smb devstack@keystone.service[88033]: [pid: 88033|app: 0|req: 1481/2967] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:29.749368 dv-cinder-856041-1-smb devstack@keystone.service[88032]: DEBUG dbcounter [-] [88032] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:39.353166 dv-cinder-856041-1-smb devstack@keystone.service[88033]: DEBUG dbcounter [-] [88033] Writing DB stats keystone:SELECT=33 {{(pid=88033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}